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CONVEYOR BELT INSPECTION SYSTEM AND METHOD 

This application claims priority to provisional patent application 60/348,634, which 
was filed on January 14, 2002 and is incorporated by reference in its entirety. 

BACKGROUND 

[0001] In underground mines such as coal mines, conveyor belt systems often are 
utilized to remove the payload from the mine. The conveyor belt system of a typical coal 
mine may have as many as twenty belts, and each belt may be as long as 20,000 feet In 
general, a belt is made from a rubber/fabric laminate and assembled by fastening together 
several belt sections end-to-end to form a continuous belt The sections of the belt often are 
joined using metal clips laced together with steel cable. Namely, a row of clips is riveted to 
the end of one belt section and laced with a row of clips riveted to the end of another belt 
section. When installed, the two sets of clips together form a splice that joins the belt 
sections. Because the lengths of the sections that form a belt may vary, there is generally no 
uniformity to the spacing of splices. 

[0002] As a splice wears, the clips can break, or be torn off the belt entirely, and the belt 
will pull itself apart. A broken belt is dangerous and can cause tons of material to be spilled, 
resulting in the shut down of production and requiring expensive clean up and repairs. A 
conservative estimate of failures is that each belt of a conveyor belt system in an underground 
mine fails once per year at a cost of on average $ 100,000 in lost revenue for the mine per 
failure. Assuming a belt system with twenty belts, this translates to a conservative estimate 
of a revenue loss of $2 million per year attributed to belt failures. 
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SUMMARY 

[0003] In one general aspect, an inspection system for detecting and reporting conditions 
of a conveyor belt may include a controller for receiving image data from at least one camera 
structured and arranged to capture an image of a portion of a conveyor belt, for detecting an 
object in the portion of the conveyor belt based on the received image data, and for 
generating status information associated with the portion of the conveyor belt based on the 
detected object. The system may further include a user interface, in communication with the 
controller, configured to display a visual representation of the status information. 

[0004] Implementations may include one or more of the following features. For 
example, the controller may classify the detected object and analyze the detected object based 
on object classification. For example, the detected object may include a mechanical splice. 
The controller may detect the mechanical splice by edge filtering the image data, by 
searching for a zipper pattern in image data, and/or by searching for a hole pattern in the 
image data. The status information may include a score assigned to the detected mechanical 
splice by the controller. The score may be based on a zipper hole pattern and/or a number of 
functional clips included in detected mechanical splice. 

[0005] The detected object also may include a vulcanized splice. The controller may 
detect the vulcanized splice by locating at least one fiduciary marking corresponding to the 
location of the vulcanized splice. The controller may locate the at least one fiduciary 
marking by edge filtering, for example. The fiduciary marking may be vulcanized to the 
conveyor belt and include at least one of a mark, patch, pattern, shape, line or grid. The 
controller may locate the center and/or a rotation angle of the at least one fiduciary marking. 
In some cases, the controller may locate a pair of fiduciary markings bounding the vulcanized 
splice. 
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[0006] The detected object may include a material defect in the belt such as a hole, rip, 
worn edge, splice, score, or gouge in the conveyor belt. The detected object also may include 
a belt marking. The controller may analyze the belt marking for distortion (e.g., stretching 
indicative of a defective condition of the conveyor belt and/or locate a center of one or more 
belt markings. The belt marking may be vulcanized to the conveyor belt and include at least 
one of a mark, patch, pattern, shape, line, or grid. 

[0007] The detected objept may include reflected light. The reflected light may be 
generated by a focused light source structured and arranged to direct focused light at the 
conveyor belt. The focused hght source may include a laser. The controller may generate a 
range profile based on properties of the reflected light, and the status information may 
include a three-dimensional topography of the conveyor belt based on the range profile. 
[0008] The status information also may include a digital image of the detected object 
and/or a plurality of digital images of the detected object captured over a period of time. The 
images may show degradation of the detected object over time. The status information may 
include an alarm condition. 

[0009] The controller may be configured to assign an identification tag to a detected 
object. The identification tag may be assigned based on at least one of a reference object, a 
point-of-origin, recognized pattern, correlation between images, a health score, and object 
degradation. 

[0010] The system may include an encoder for monitoring speed of the conveyor belt 
and/or a remote element, in communication with the controller, for enabling remote access to 
the status information. 

[0011] Aspects of the present invention may be implemented by an apparatus, method, 
and/or program stored on a computer readable medium. 
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DESCRIPTION OF THE DRAWINGS 

I 

[0012] Fig. 1 illustrates one embodiment of a conveyor belt system. 
[0013] Fig. 2 illustrates one embodiment of a belt inspection system. 
[0014] Fig. 3 A illustrates one embodiment of a housing for a belt inspection system. 
[0015] Fig. 3B illustrates one embodiment of a housing assembly for a belt inspection 
system. 

[0016] Fig. 4 illustrates one embodiment of a belt inspection system program. 
[0017] Fig. 5 illustrates one embodiment of an example of raw image data and extracted 
mechanical splice image data. 

[0018] Fig. 6 illustrates one embodiment of a raw belt image and edge intensity image, 
[0019] Fig. 7 illustrates one embodiment of an edge image and row scores. 
[0020] Fig. 8 illustrates one embodiment of edge row sums and running window sum. 
[0021] Fig. 9 illustrates one embodiment of row scores, running window sums and 
threshold. 
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[0031] Fig. 19 illustrates one embodiment of pixel scores, row sums and final row 
scores. 

[0032] Fig. 20 illustrates one embodiment of row scores and running window sum. 
[0033] Fig. 21 illustrates one embodiment of row scores and ruiming window sum. 
[0034] Fig. 22 illustrates one embodiment of a mechanical splice clips wi& different 
types of defects. 

[0035] Fig. 23 illustrates one embodiment of a defective mechanical splice. 
[0036] Fig. 24 illustrates one embodiment of a defective mechanical splice. 
[0037] Fig. 25 illustrates one embodiment of a defective mechanical splice. 
[0038] Fig. 26 illustrates one embodiment of a defective mechanical splice. 
[0039] Fig. 27 illustrates one embodiment of a defective mechanical splice. 
[0040] Fig. 28 illustrates one embodiment of a mechanical spUce. 
[0041] Fig. 29 illustrates one embodiment of a mechanical splice scoring algorithm. 
[0042] Fig. 30 illustrates one embodiment of an image of a detected mechanical splice 
and an extracted portion of the mechanical splice. 

[0043] Fig. 3 1 illustrates one embodiment of sorted column variances of a mechanical 
splice and column variances with mean and threshold shown. 

[0044] Fig. 32 illustrates one embodiment of a mechanical splice having zones. 

[0045] Fig. 33 illustrates one embodiment of a portion of a mechanical splice and a 
vertical edge magnitude image. 

[0046] Fig. 34 illustrates one embodiment of an edge template pattem. 
[0047] Fig. 35 illustrates one embodiment of a maximum template response. 
[0048] Fig. 36 illustrates one embodiment of a vertical edge magnitude image. 
[0049] Fig. 37 illustrates one embodiment of a portion of a mechanical splice with 
primary and secondary holes. 
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[0050] Fig. 38 illustrates one embodiment of clip edge alignmmt tyjpes. 
[0051] Fig. 39 illustrates one embodiment of top row clips - ri^t edge aligned 
templates. 

[00521 Fig- 40 illustrates one raibodiment of top row clips - left edge aligned templates. 
[00531 Fig. 41 illustrates one embodiment of applying clip templates. 
[00541 Fig. 42 illustrates one embodiment of a bottom row clips - right edge aligned 
templates. 

[00551 Fig- 43 illustrates one embodiment of a bottom row clips - left edge aligned 
templates. 

[00561 Fig. 44 illustrates one embodiment of applying clip templates. 
[00571 Fig. 45 illustrates one embodiment of clip mate assOTibly styles. 
[00581 Fig. 46 illustrates one embodiment of a hole growing process. 
[00591 Fig. 47 illustrates one embodiment of a scoring result of a mechanical splice. 
[00601 Fig. 48 illustrates one embodiment of scoring results on mechanical splice clips. 
[00611 Fig. 49 illustrates one embodiment of scoring results on mechanical splice clips. 
[00621 Fig. 50 illustrates one embodiment of scoring results on a mechanical splice. 
[0063] Fig. 5 1 illustrates one embodiment of a raw data and edge space clips. 
[0064] Fig. 52 illustrates one embodiment of a fiducial patch design. 
[0065] Fig. 53 illustrates one embodiment of a vulcanized splice detection algorithm. 
[00661 Fig. 54 illustrates one embodiment of a data structures and computation involved 
in computing edge score. 

[00671 Fig- 55 illustrates one embodiment of a horizontal profile of window sums for a 
fiducial patch. 

[0068] Fig. 56 illustrates one embodiment of a horizontal profile of window sums for a 
mechanical splice. 
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[0069] Fig. 57 illustrates one embodiment of a fiducial detector estimate of mechanical 
splice. 

[0070] Fig. 58 illustrates one embodiment of fiducial detection and classification. 

[0071] Fig. 59 illustrates one embodiment of a fiducial detector estimate. 

[0072] Fig. 60 illustrates one embodiment of computing edge angle histogram and center 
of mass. 

[0073] Fig. 61 illustrates one embodiment of filters for computing the magnitude and 
angle of edges. 

[0074] Fig. 62 illustrates one embodiment of an edge angle histogram. 

[0075] Fig. 63 illustrates one embodiment of a histogram. 

[0076] Fig. 64 illustrates one embodiment of estimating center using detected borders. 

[0077] Fig. 65 illustrates one embodiment of binary image morphology. 

[0078] Fig. 66 illustrates one embodiment of a dilation operation. 

[0079] Fig. 67 illustrates one embodiment of a circle template. 

[0080] Fig. 68 illustrates one embodiment of a fiducial algorithm. 

[0081] Fig. 69 illustrates one embodiment of locating the center of a fiducial patch. 

[0082] Fig. 70 illustrates one embodiment of a graphical user inter&ce. 

[0083] Fig. 71 illustrates one embodiment of a camera configuration interface. 

[0084] Fig. 72 illustrates one embodiment of an encoder configuration interface. 

[0085] Fig. 73 illustrates one embodiment of a mechanical splice detection configuration 
interface. 

[0086] Fig. 74 illustrates one embodiment of a data logger configuration interfece. 

[0087] Fig. 75 illustrates one embodiment of a data player configuration interface. 

[0088] Fig. 76 illustrates one embodiment of an identification configuration interface. 
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{0089] Fig. 77 illustrates one embodiment of a mechanical splice scoring configuration 
interface. 

[0090] Fig. 78 illustrates one embodiment of a general configuration interfece. 

[0091] Fig. 79 illustrates one embodiment of a fiducial detection configuration interface. 

[0092] Fig. 80 illustrates one embodiment of a conveyor belt ^em. 

[0093J Fig. 8 1 illustrates one embodiment of three-dimensional belt topography. 

DETAILED DESCRIPTION 

[0094] In one general aspect, the present invention is directed to systems and techniques 
for detecting defective conditions in a conveyor belt that may contribute to belt failure and 
for alerting management and/or maintenance personnel of such conditions prior to belt 
failure. For simplicity, the basic components of such systems and techniques are provided. 
However, as would be understood by one of ordinary skill in the art, the systems and 
techniques described below may include various other componwits and structures in actual 
implementation consistent with aspects of the present invention. 

[0095] One embodiment of a conveyor belt system 10 is illustrated in Figure 1 . As 
shown, the conveyor belt system 10 includes a belt 12 that forms a continuous loop rotated by 
the turning of cylindrical drums or rollers 14 mounted to a chassis 16. In general, a payload 
18 such as coal or other material may be carried and transported on the outer surface of the 
belt 12. A typical operating speed of the belt 12 may be around 800 feet per minute. Other 
operating speeds are contemplated and the speed of the belt 12 may vary during the course of 
use. For instance, as the belt 12 is started and stopped, the speed of the belt 12 may ramp up 
to its operating speed or ramp down to a halt 

[0096] Jn the embodiment depicted in Fig, 1 , the conveyor belt system 1 0 includes a beh 
inspection system (BIS) 20 for detecting and reporting conditions of the conveyor belt 12. In 
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general, the BIS 20 is configured to handle variations in the speed of the belt 12 and operate 
at a rate high enough to process and detect conditions at the maximum speed of the belt 12. 
In some embodiments, the BIS 20 may be positioned over and aimed at the inner surface of 
the belt 12, as shown, such that the BIS 20 is not aimed at portions of the belt 12 where the 
payload 1 8 is carried. In some case, the BIS 20 may be aimed at the payload side of the belt 
12. Generally, a spot may be found to monitor a portion of the payload side of the belt 12 
fhat is not covered by the payload 18. The BIS 20 may be mounted to the chassis 16, 
suspended from the chassis 16, and/or supported over the belt 12 such that the BIS 20 is 
properly positioned to detect conditions of the conveyor belt 12. 

[0097] In some implementations, the BIS 20 may automatically monitor the quality of 
belt splices where the belt is most likely to fail. For example, the BIS 20 may perform 

m 

mechanical splice detection, vulcanized splice detection, and/or other types of splice 
detection. With regard to mechanical splice detection, the BIS 20 may detect the mechanical 
splices, generate a digital image of the splice, determine the number of functional splice clips 
(i.e. "score*'), alert mine personnel to the condition (e.g., Good, Fair or Bad) of the 
mechanical splices used to join two pieces of mine conveyor belt together, uniquely identify 
the splice by location on the belt via one of several methods, keep a record of the splices for 
viewing a history of deterioration, and/or display the mechanical splice on a user interface 
and publish the image over a network (e.g., Etiiemet) to a web-based application. 
[0098] With regard to vulcanized splice detection, the BIS 20 may detect vulcanized 
splices by use of a fiducial marking vulcanized to either end of the splice, detect the center of 
each fiducial marking, determine the distance from center to center, use the center to center 
distance to detemiine the historic stretch of the splice which may indicate approaching splice 
failure, uniquely idmtify the splice by location on the belt via one or several methods, keep a 
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record of the splices for viewing a history of deterioration, and/or display the splice on a user 
interface and publish the image over a network (e.g., Ethernet) to a web-based application. 
[0099] In some cases, the BIS 20 may detect belt defects in addition to or independent of 
performing spUce detection. Examples of defects include, but are not limited to, holes, rips, 
edge wear, "flappers", gouging, "pi2zza cutters" and/or any other defect which left un-repaired 
may cause spUce or belt faUure. In some implementations, the BIS 20 may generate a 
topography of the belt which is capable of being examined for geometric defects. In other 
implementations, the BIS 20 may detect deformation m one or more belt markings (e.g., 
fiducial markings) indicating splice failure and/or excessive wear of the belt. Images may be 
displayed on a user interface and/or may be published over a network (e.g., Ethernet) to a 
web-based application. 

[00100] One embodiment of a BIS 20 is illustrated in Fig. 2. As shown, the BIS 20 
includes a controller 200 in communicatiion with one or more detectors. In general, the 
controller 200 may be implemented as one or more computers and/or computer systems for 
performing the functions described herein. Examples include, but are not limited to, a 
general-purpose computer, a special-purpose computer, a personal computer (PC), a 
workstation, a network server, a terminal, a virtual machine, a laptop computer, a 
microprocessor, an integrated circuit, or any other device, machine, tool, equipment, 
component, or some combination thereof capable of responding to and executing instructions. 
[00101] As depicted, the controller 200 may include ports such as, for example, a first 
digitize port 201, a second digitizer port 202. an encoder port 203, a network port 204. an 
input/output (I/O) port 205, a memory port 206, a video port 207, a first serial port 208, and a 
second serial port 209. The ports 201-209 may be used to connect the controller 200 through 
wired and/or wireless connections to various other components of the BIS 20. The controller 
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200 also may include a power supply 210 (e.g., 110 VAC) for supplying power to the 
controller 200 among other elements, as described below. 

[001021 In one implementation, the power supply 210 powers detectors including a first 
camera 21 1 and a second camera 212 that are stmctured and arranged to provide the 
controller 200 with images of a conveyor belt Upon installation, the two images, captured 
respectively by the first camera 21 1 and the second camera 212, are merged through an 
overlap and an offeet adjustment to provide a single image fiame. Such adjustment and 
others (e.g.. camera focus) may be performed locally and/or performed remotely when the 
BIS 20 is connected to a network. While the use of dual cameras 211, 212 is advantageous, it 
is contemplated that the BIS 20 may employ a single camera capable of imaging the entire 
widtii of the belt in other embodiments. 

[00103] In one implementation, the cameras 21 1 , 212 are Ime scan cameras attached to 
the controUer 200 through digitizer ports 20 1 , 202. Each of the cameras 21 1 , 2 12 may 
provide a digitized image containing one row of pixels that spans a Uttle over half the belt 
Given a belt speed of 800 feet per minute and a requirement of 50 pixels per inch resolution, 
for example, each of the cameras 21 1. 212 may capture a line of the image at about 8000 
times per second. In such a case, the cameras 211, 212 generate 4096 pixels per line 
(covering 82 inches of belt width) yielding roughly 32 megabytes of data per second. While 
line scan cameras are used in this embodiment, it is contemplated that the BIS 20 may 
employ other types of cameras such as one or more.area scan cameras, for instance. 
[00104] hi one embodiment, the encoder port 203 connects the controller 200 to an 
encoder 213. M general, the encoder 213 may perform functions for computing the current 
belt speed and position, computing desired digitized line rate based on the current belt speed, 
and recordmg the belt speed - including monitoring the amount of time the belt is idle. The 
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controller 200 may include a PC interfece card (e.g., PCI 6601) for powering the encoder 213 
at low voltage. 

[001051 While the use of the encoder 213 may not be required in all cases, it is practical 
to do so. The line scan cameras 21 1, 212 capture an image that includes one line of pixels 

the belt To provide image-to-image uniformity and a fixed image resolution, then line 
density in the long axis of the belt should be controlled. This may be accomplished using the 
encoder 213 by adjusting the camera firing rate to the current (actual) belt speed. In the 
absence of an encoder 213, the user may set the camera firing rate based on a fixed 
(approximate) belt speed which may result in distorted images on belt start-up and shut- 
down. 

[001061 Another advantage of flie encoder 21 3 is fliat if user mputs into the system an 
accurate count of the number of spUces on the belt, then at the interface on the physical 
installation the user can see updated in real time the distance any spUce is &om the system 
and the time before the splice will return. This is usefiil when one is trying to bring a splice 
to be remade to the splicing station because belts are fi:equentiy broken as they are jogged to 
get an offending splice to the splicing station. 

[001071 The network port 204 may connect the controller to a mine network 214. The 
network 214 may include, or form part of, one or more of: a local area network (LAN), 



mme 



a wide area network (WAN), the Internet, the Web, a telephony network (e.g., analog, digital, 
wired, wireless, PSTN, ISDN, or xDSL), a radio network, a television network, a cable 
network, a satellite network, and/or any other wired or wireless communications network 
configured to carry data. The mine network 214 may include one or more elements, such as, 
for example, intermediate nodes, proxy servers, firewalls, routers, switches, adapters, sockets, 
and wired or wireless data pathways, configured to direct and/or deliver data. According to 



one 



embodiment, the mine network 214 may communicate inspection data to a remote 
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display unit (not shown) so that a belt may be inspected from a remote location. Examples of 
a remote display device include, but are not Umited to. a remote personal computer (PC), 
workstation, server, laptop computer, web-enabled telephone, web-enabled personal digital 
assistant (PDA), microprocessor, integrated circuit, or any other component, machine, tool, 
equipment, or some combination thereofl 

[001081 The I/O port 205 may connect to the controller 200 to one or more peripheral 
devices 215 for inputting and/or outputting information. Examples of peripheral devices 215 
include, but are not Ihnited to, a mouse, a keyboard, a display monitor with or without a 
touch screen input, a mobile phone, a personal digital assistant, a printer, a facsimile machine 
or any other device for inputting and/or outputting data. 

[001091 Hie memory port 206 may comiect the controller 200 to a storage device 21 6 for 
storing and transferring data. In one embodiment, the storage device 216 may include a 
removable disk such as, for example, a FireWire hard drive. Tins allows quick removal of 
datalogged images for system improvements. As shown, fee storage device 216 may be 
powered by a separate power supply 217. 

[001101 The video port 207 and the first serial port 208 may connect the controller 200 to 
a UI 21 8. In one embodiment, the UI 218 may mclude a display such as, for example, a 
NEMA 4 touch screen display. In general, the UI 218 allows a user to view digitized images 
capped by the cameras 201 , 202 and to configure the system. As shown, the UI 21 8 also 
may be powered by the power supply 210. 

[OOlUl The power supply 210 may be connected through a power off delay relay 219 to a 
battery backup or uninterruptible power supply (UPS) 220. Ilie UPS 220^^^ 
battery backed-up surge protected outlets as well as non backed-iq, surge protected outlets 
and may be comiected to the controller 200 through the second serial port 209. In one 
implementation, the UPS may provide back-up power, for various components of the BIS 20, 
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including the power supply 210 of the controller 200 and the power supply 217 for the 
storage device 216. 

[00112] As shown, the UPS 220 and may be cooled by a fan 221 and further connected to 
a power distribution block 222, which also may be cooled by a fan 223. The power 
distribution block 222 may be connected through a power line filter 224 and a power on relay 
225 to the mine power center 226. As the overall system may pull around 4000 watts of 
power, extension cords ftom the power center 226 may be infeasible due to voltage drops. 
The power center 226 may include 480 AC outlets for connecting to the power distribution 
block 222. The power line filter 224 may offer a transformer and circuit breaker protection 
for the system. A power on switch 227 connected to the power on relay 225 and a power 
indicator light 228 may allow the safe operation and visual status of the 480 AC mput 
[00113] The power distiibution block 222 may be connected througih a first fuse 229 and 
a second fuse 230, respectively to a first light array 23 1 and a second Hght array 232. In 
general, the light arrays 231, 232 enable the use of the system in dark environments. In 
general, each of the light arrays 231, 232 includes a radiant energy source 233, 234. In the 
embodiment of Fig. 2, each of the radiant energy sources 233, 234 includes a plurality (e.g., a 
line of 17) light emitting diodes (LEDs). Each of the light arrays 23 1. 232 also may mclude a 
power supply 235, 236 and a cooling fan 237, 238. 

[00114] In some embodiments, a protective housing may be provided to protect one or 

elements of the system. Fig. 3A illustrates one embodiment of aprotective housing 30 
that may be used to protect one or more elements of the BIS 20. The housing 30 may enclose 
one, some, or all of the components of the BIS 20. 

[00115] As shown, the housing 30 includes a first end enclosure 301 which may contain 
computer elements such as. for example, the controller 200, the storage device 216, and the 
storage device power supply 217. The housing 30 includes a second end enclosure 302 



more 
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which may contain the UI 218 and power distribution elements such as, for example, the 
power off relay 219, the UPS 220, the fan 221 , the power distribution block 222, the fan 223, 
the power line filter 224, the power on relay 225, the power on switch 227, and Ihe power 
indicator light 228. The end enclosures 301, 302 are connected by a first cross member 303 
and second cross member (not shown), through which cabling is run and cooling air is 
circulated via fans 221, 223. The housing 30 further includes a first lower member 305 and a 
second lower member 306, which may contain elements of the first light array 23 1 and the 
second light array 232, respectively. 

[00116] In one embodiment, the housing 30 may include chains 307 attached by bolts 308 
at extending portions 309. The housing 30 may be mounted by wrapping each the chams 307 
around the bed rail of the top belt then looping each of the chains 307 through one of the 
bolts 308 and attaching each of the chains 307 to a descending portion of itself The length of 
the chains 307 may be adjusted to ensure the proper separation between the housing 30 and 
the monitored portion of the belt. In one implementation, the cameras should be set at about 
29 inches firom the belt, which puts the top of the housing 30 at about 36 inches from the belt. 
In the case of a panel belt where the belt may be angled and then flattens at the snub roller 
ahead of the stationary take-up pulley, the chains 307 may be adjusted to put the housing 30 
perpendicular to the belt. 

[001171 When utilized, the encoder 213 may be enclosed within the housing 30 or 
enclosed by a separate housing. There may be considerable variation site-to-site in encoder 
installation. On a panel belt, for example, the encoder typically is mounted on the snub roller 
ahead of the take-up but the mounting can vary depending on whether the roller is solid or 
hollow. In one embodiment, an encoder wheel may be used where there are no available 
rotating elements to which a standard encoder can be affixed to at installation site. 
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[00118] Fig. 3B illustrates one embodiment of a housing 30 as an assembly. As shown, 
the end enclosures 301, 302 and the cross members 303, 304 maybe hnplemented as one 
piece of the assembly including mounting brackets 310 for attaching the lower members 305, 
306. Between the cross members 303, 304 are two additional membws 3 1 1 , 3 12 that run 
parallel to the long axis of the belt and may house the first camera 211 and the second camera 
212, respectively. Each of the lower members 305, 306 includes a heat sink 3 13 and a cover 
3142 for protecting the LEDs 315. The heat sink 311 improves lighting efficiency. 
[GDI 191 Although not shown, brattice cloth may be attached with ties on the outside of 
the housing 30 to prevent splashing of dirty water on the lights and cameras. When there is 
moisture the belt, such splashing can occur as the belt encounters the snub roller. In general, 
the glass cover protectmg the camera lens from the mine environment should be checked and 

r, 

wiped cleaned on a regular basis (e.g., every week). In addition, each heat sink 3 1 1 and 
cover 3 12 should be checked and cleaned when dirty. 

[00120] In one embodiment, the BIS 20 operates in tandem with and/or at the direction a 
program. Examples include, but are not Umited to, a computer program, a software 
application, computer code, set of instructions, plug-in, applet, or combinations thereof, for 
independently or collectively mstructing one or more computing devices to interact and 
operate as programmed. The program may be run, for example, by a controller 200, when 
implemented as a computer or a computer system. 

[00121] Fig. 4 illustrates one embodiment of a program 40 that may be hnplemented by 
the BIS 20 to analyze detected conditions of a conveyor belt that may lead to fixture belt 
failure. As described in more detaU below, the program 40 may include local (e.g., 



underground) elements for controllmg cameras, collecting encoder data, capturing images, 
providing a user interface for belt inspection at the system installation point as well as remote 
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(e.g., Web server) elements for collecting images captured by an underground unit, storing 
such images in a database, and distributing images to computers networked to a web server. 

[00122] In general, the computer program 40 may utilize any suitable algorithms, 
computing language (e.g., Java, Perl, C or C++), and/or object-oriented techniques. The 
program 40 may be embodied permanently or temporarily in any type of computer, computer 
system, device, machine, component, physical or virtual equipment, storage medium, or 
propagated signal capable of delivering instructions. The program 40 when unplemented as 

software or a computer program, for example, may be stored on a computer-readable medium 

(e.g., device, disk, or propagated signal) such that when a computer reads the medium, the 

functions described hCTein are performed. 

[001231 As shown, the program 40 includes several components, witii each component 
represented by its own thread. The graphical user interface thread 400 provides an intuitive 



user 



more 



interface for displaying object image data and for viewing and configuring system 
parameters. The graphical user interface thread 400 may receive inputs including one or 

data structures containing aU system configuration and ran-time parameters. The inputs 
to the graphical user interfece thread 400 may be received fi:om a disk 401, which may be 
implemented by the internal memory of the controller 200 and/or the storage device 216. The 
outputs of the graphical user mterface thread 400 may be presented as a graphical display of 
system parameters and data on a main display 402. The main display 402 may be 
unplemented, for example, by the UI 218 and/or by a remote display device. 
[001241 The encoder interface thread 403 may be responsible for interfecmg through an 
encoder controller card 404 to an encoder 405, computing current belt speed and position, 
computing desired digitizer line rate based on the current belt speed, and recording the belt 
speed— including monitoring the amount of time Ihe belt is idle. The encoder interface 
thread 403 may receive inputs including number of encoder counts per meter from a user, 
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time interval to compute belt speed over from a user, frequency to log belt motion statistics to 
disk from user, number of pixels per inch on the belt from user, and/or current encoder count 
from the encoder control card 404. The encoder interfece thread 403 may output current belt 
speed, current belt position, and/or desired line rate obtained by multiplying the belt speed 
(inches/seconds) by the pixels per mch on the belt 

[00125] The camera interface thread 406 may be responsible for controlling one or more 
cameras 407, 408 via a digitizer card 409, stamping and loading captured image data from 
caphired image buffers 410 into a live belt image ring buffer 41 1, and managing the live belt 
image ring buffer 4 1 1 . The camera interface thread 406 may receive inputs including desired 
camera gain from the user, desired exposure time from a user, desired line rate from a user 
and/or from the encoder interface thread 403, and/or image alignment values from a user. As 
outputs, the camera interfece fliread 406 may set flie deshed camera gain, set the desired 
exposure time, set the desired line rate, and/or stamp received images from the digitizer 409 
in the capture buffers 410 and copy them into the live beh image ring buffer 41 1. 

[00126] The object detector thread 412 may be responsible for processing the live beh 
data contained in the Uve belt image ring buffer 41 1 in order to detect various objects on the 
belt, and for exti:acting and loadmg detected objects into tiie object analyzer dynamic ring 
buffer 413. The object detector thread 412 may receive inputs including a pointer to 

unprocessed live belt image data contained in the live belt image ring buffer 41 1 . Outputs 

from tiie object detector thread 412 may include detected objects into tiie object analyzer 

dynamic ring buffer 413. 

[00127] The object analyzer-ID thread 414 may be responsible for analyzing tiie objects 
m tiie object analyzer dynamic ring buffer 413 and for adding analyzed objects to an object 
table of contents 415. The object analyzer-ID tiiread 414 may receive inputs including 
detected object image and location. Outputs from tiie object analyzer-ID tiuead 414 may 
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include analysis results and/or addition of objects to the object table of contents 415. In some 
cases, an identification number is assigned to objects and object image, stamp and analysis 
infoimation is stored on a disk 41 6. 

[001281 The network lO thread 417 may be responsible for communicating the state of 
the system to a surface machine 418. The suifece machine 41 8 may be implemented, for 



example, as a web application server. • The network lO thread 417 may receive inputs 
including detected object images, belt speed and length, state of object belt pattern, and/or 
pattern list of objects on belt vwth respect to point-of-origin. Outputs &om. the network 10 
thread 417 may include general status information such as current belt speed and length and 
periodical state of object pattern, compressed object image data (e.g., JPEG format) after 
each object is detected, and/or pattern list of objects on belt with respect to point-of-origin 
after each belt revolution. 

[00129] The live belt image logger thread 419 may be responsible for stampmg and 
logging all captured tive belt image data Id the disk 401. Tlie live belt image logger thread 
419 may receive inputs including Kve belt image data and stamp information from the live 
belt image buffer 41 1 . Outputs from the live belt image logger thread 419 may include live 
belt image data and stamp information to the disk 40 1 . 

[001301 The digitizer hardware handler tiiread 420 may be responsible for determining 
when a hardware exception handler error occurs and for resetting the capturing of image data 



upon detection of an error. Ilie digitizer hardware handler thread 420 may receive mputs 
luding a hardware exception signal error from the digitizer card 409. Outputs from the 



mc 



digitizer hardware handler thread 420 may reset a digitizer flag to be true. 
[001311 The digitizer overflow handler thread 421 may be responsible for determining 
when an overflow exception handler enor occurs and for resetting tiie captiiring of image 
data upon detection of such an error. The digitizer overflow handler fliread 421 may receive 
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inputs including an overflow exception signal error from the digitizer card 409. Outputs from 
the digitizer overflow handler thread 421 may reset a digitizer flag to be true. 
[001321 The data player thread 422 may be responsible for playing back previously 
recorded live belt data stored on a disk 423. The data player thread 422 may receive inputs 
including base directory where Uve belt images are stored and/or start and stop image index 
to play back through the system. Outputs from the data player thread 422 may load image 
data and stamp information into the live belt image ring buffer 41 1 and set belt speed, length, 
and position based on information contained in the header of the live belt image. 
[001331 In one implementation, the BIS system 20 may operate in one of two modes. 
Namely, a Uve data mode where live image data from the cameras are captured and processed 
by the system or play back data mode where previously logged images are read from disk and 
processed by the system. The flow of data throughout the BIS system 20 when in one of 
these modes is described below with reference to Fig. 4. 

[001341 In the Uve data mode, the BIS 20 captures and processes Uve imagery captured 
from the cameras 407, 408. In one implementation, the active threads in the live data mode 
include the graphical user interface thread 400, the encoder interface thread 403, the Uve belt 
image logger thread 419, the object detector thread 412. the object analyzer-ID thread 414, 
the network lO thread 417, the camera interface thread 406, the digitizer hardware handler 
thread 420, and the digitizer overflow handler thread 421. In this implementation, the 
graphical user interface fihread 400 is the first thread started and reads in (from disk 401) and 
sets aU system configuration settings, and aUocates and initializes aU data structures for the 
entire system. The graphical user interface thread 400 then launches each of the other active 
threads in the system. 

[001351 The encoder interface thread 403 controls the main flow of data from this point. 
The encoder interface thread 403 periodically reads the current encoder count contained on 
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the encoder controller card 404 and uses this mformation to update the position and speed of 
the belt. Based on the current speed of Ihe belt and the camera pixel resolution, the encoder 
interface thread 403 computes and sets the desired camera digitizing line rate. 
[001361 Hie camera interfece thread 406 is continuously capturing data from the cameras 
at the highest line rate the system will ever requke, based on the highest belt speed that the 
system wUl experience. "Hie two capture buffers 410 are configurable in the mmiber of lines 
of image data that each can hold (e.g., set to 512). The digitizer card 409 uses these capture 
buffers 410 in an alternating feshion where it copies new captured image data into one of the 
buffers untU it is full, notifies the camera interface thread 406 that new image data is ready to 
process in that buffer, and then continues to copy new image data into the next capture buffer. 
When the next capture buffer is full, the digitizer 409 notifies the camera interface thread 406 
that data is ready to be processed in that buffer and continues to copy new image data again 
in the first buffer and so on. 

[001371 Each time the camera interfece thread 406 is notified that there is new data to 
process, it copies the appropriate new image lines, which are determined by knowing the 
current and desired digitizing line rate, into the Uve belt image ring buffer 41 1 . Each time a 
new image line is copied over to the Uve belt image ring buffer 41 1. the camera interface 
thread 406 stamps the data with various information on the state of the system when the 
image was captured (e.g., belt speed and position, digitizing rate, camera gain, exposure time, 
etc.) and updates pomters to the latest/current image data. Other threads in the system use 
this pointer to determine what data is new and has not been processed yet 
[001381 When the live belt image logger thread 419 is enabled, it periodicaUy checks to 
see if new data exists in the live belt image ring buffer 41 1 . If new data is found, the live belt 
image logger tiiread 419 logs the new image data tx, disk 401 along with its image stamp 
information of the belt and camera settings when the new image data was captured. 
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[00139] The digitizer hardware handler thread 420 monitors hardware exception errors 
fliat the digitizer card 409 reports to the application when they occur. Every time a hardware 
exception signal is received by the digitizer hardware handler thread 420, it sets a flag that 
informs the camera interface thread 406 to reset (stop and restart) digitizing in order to insure 
correct synchronization with the data coming from both cameras 407, 408. 
[00140] The digitizer overflow handler thread 42 1 monitors overflow errors that the 
digitizer card 409 reports to the application when they occur. These typically occur when 
there is too much activity on the PCI bus and the digitizer 409 could not deliver all of the 
image data to the capture buffers 410, which may reside in local computer memory space. 
Every time an overflow exception signal is received by the digitizer overflow handler thread 
421, it sets a flag that informs flie camera interfece thread 406 to reset (stop and restart) 
digitizing in order to insure correct synchronization with the data coming from both cameras 
407, 408. 

[00141] The object detector thread 412 watches flie live belt image ring buffer 41 1 
looking for new image data to arrive. When it does, the object detector thread 412 runs one 
or more object detection algorithms on the data to determine whether or not an object is 
present in the image data. Every time an object is detected, image data and stamp 
information is extracted from the live belt image ring buffer 41 1 and placed in the object 
analyzer dynamic ting buffer 4 1 3 along with the type of object that is contained in the image. 
[00142] The object analyzer-ID thread 414 processes objects that are contained in the 
object analyzer dynamic ring buffer 413 in a first-in-first-out (jFIFO) manner. Each analysis 
algorithm that is run on the object image is determined by the type of object contained in the 
object analyzer dynamic ring buffer 413. After the object has been analyzed, it is added to 
the object table of contents 415. 
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[001431 The object table of contents 415 stores and manages a fixed size list of objects 
that have been detected by the system. In addition, the object table of contents 415 manages 
the identification of object IDs. When a request is made to add a new object, the object table 
of contents 415 first determines the proper ID to assign to the object It then logs the object 
image to disk 416 along with the image stamp, object ID, and object analysis results. A 
record of where Ihe object is stored on flie disk 416, object ID, the image stamp and object 
analysis results are stored within the object table of contents 415 so that the object image can 
be retrieved for display at a later time. 
[001441 The network 10 thread 417 is in charge of sending all system information firom 
the BIS 20 to the surfece server machine for display and storage. One message that is sent, 
may contain the image data of an obj ect and its analysis results. The network 10 thread 417 
monitors the object table of contents 415 and sends out this message every time a new object 
is added to the object table of contents 415. Another message that is sent may contain 
information on the current length of the belt, the current number of objects on the belt, and 
the pattern in which those objects occur all of which have been determined by the BIS 20. 
The pattem is with respect to the point-of-origin on the belt which can be either the first 
object detected by the BIS 20 or by detecting an actual fiduciary point-of-origin that has been 
placed on the belt. This message may be sent out once per revolution of the belt Another 
message is a general status message which contains information on whether or not the current 
object pattem on the belt is known, and the current speed and position of the belt This 
message may be sent out periodically. 

[00145] The graphical user interfece thread 400 periodically may update the display 402 
with the latest system information. In one implementation, the main piece of data that is 
updated is the object display window which displays the detected object image and various 
information about the object How the window is updated depends on what mode of updating 
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the system is in, which can be either manual, current, or loop. In manual mode, the object 
display window only gets updated when the user clicks on the go to next or previous object 
buttons. In current mode, the graphical user interfece thread 400 always updates the display 
with the most recent object detected by the system. In loop mode, the graphical user interfece 
thread 400 periodically loops over a configurable amount of objects that have been detected 
by Ihe system. 

[00146] In play back data mode, Ihe BIS 20 uses previously captured and logged image 
data from the cameras 407, 408 contained on disk as input to the system to process. In one 
implementation, the active threads in play back data mode include the graphical user interface 
thread 400, the Uve belt image logger thread 419, the object detector thread 412, the object 
analyzer-E) thread 414. &e network 10 Ihread 417, and the data player thread 422. 
[001471 The flow of data in play back mode is nearly idaitical to that of the live data 
mode, described above. In play back mode, the data player Ihread 422 acts as a sunulator for 
the entire system. Namely, the data player thread 422 is given a base dureclory location of 
where the previously logged Uve belt images are stored and a range of image values to loop 
over. The data player thread 422 reads in the live belt images from disk 423 one image at a 
time. As a result of reading in the hnage, the data player thread 422 has a buffer containing 
the live belt image and the unage stamp information which was stored in Ihe image header 
located on the disk 423. 

[00148] Each time the data player thread 422 reads in a new image, it loads tiie image 
data into the live belt image ring buffer 41 1 and stamps the image data with the stamp stored 
in the image header. This simulates the camera interfece thread 406 receivmg data from the 
digitizer 409 and copymg the data from the capture buffers 410 into the live belt hnage ring 
buffer 411. The belt speed, position, length and other system variables are also updated by 
the data player thread 422 with the information that was stored in the image header. This 
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Simulates the encoder interfece thread 403 computing this infonnatiou. Aside from these 
differences, the test of the data flow in the system continues in substantially the same manner 
as in the live data mode scenario above. 

[00149] In one embodiment, the BIS 20 may be configured to perform mechanical splice 
detection and analysis. In general, mechanical splice detection deals wifli the identification 
of mechanical splices as live imagery is collected. Mechanical sphce detection may include 
monitoring all raw image data and extractmg only those sections of imagery that contain a 
mechanical splice. Fig. 5 illustrates an example of raw image data shown on the left and 
extracted mechanical spUce image data shown on the right. 

[00150] The BIS 20 may utilize several mechanical splice detection algorithms. Each 
algorithm may look for a mnque feature that only occurs in mechanical spUces. In one 
implementation, the underlying goal of each algorithm is to find a score for each line of 
pixels in the raw image data that was produced by the camera. By examining these scores, 
the algorithm determines where a mechanical splice is located and marks it as a mechanical 
spUce. That section of imagery is then extracted and placed into the object analyzer dynamic 
ring buffer 413 where it will be analyzed for defects. 

[00151] One embodiment of a mechanical splice detection algorithm may include 
detection based on edge information. Since the belt is continuously nmning along rollers in 
the mine, the belt develops stripes that mn lengthwise. i.e. the vertical direction, along tiie 
belt. By nmning an edge filter that strictly looks for edges that are perpendicular to the 
direction of travel of the belt, the splice is distinct from the background. 
[00152] m one implementation, edge detection is performed by creating an edge intensity 
image. The edge intensity image may be created by taking one row of image data- and 
subtracting another row of image data from it. The rows being used can be adjacent or 
separated by some configurable gap value depending on the lenses and tiie camera 
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configuration used. Fig. 6 illustrates a raw belt image on the left and an edge intensity image 
on the right. 

[00153] Next, a score can be obtained for each row of pixels by summing up tiie edge 
intensities. Fig. 7 illustrates an edge image (above) and row scores (below). The row scores 
can then be added into a running window sum for each row. When the running window sum 
reaches its maximum value, the window is centered on the splice and a detection has 
occurred. Any maximums that occur above a certain threshold are considered splices in the 
imagery. Fig. 8 illustiates edge row sums (top) and running window sum with detection 
threshold (bottom). 

[00154] The threshold used for detection can be calculated dynamically for changing 
hghting and belt situations. For example, keeping a running average of scores, the threshold 
may be chosen to stay above the running average by about fifty percent (50%) . By 
examining the number of rows that fall above the threshold (in one group), some false 
positive situations may be eliminated. Detected features that do not have the conrect width 
(which is the size of the mechanical spUce in pixels) can be discarded as felse detection. This 
may occur when the running window sum is noisy and may cross the threshold Ime a few 
times whUe climbing or falling a peak. Fig. 9 illustrates results of tixe algorithm running on a 
test rig with two spUces on a 35-foot piece of belt in a continuous loop. In the figure, row 
scores are shown above and ranning window sums and thresholds are shown below. 
[00155] Another embodiment of the mechanical splice detection algorithm may include 
comb splice detection. One distinguishing feature that a mechanical splice has is the zipper 
of holes that appears at the center of the splice. This is a very specific pattern that does not 
natiirally occur on the belt, making it useful for splice detection. Fig. 10 Ulustrates raw 
mechanical splice image (top) and intensities along the zipper highlighted in the top image 
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(bottom). Given the shape of the zipper intensities along a row (appearing as the teeth of a 
comb), high scores are obtained when this regular pattern is observed. 
[00156] It is important to note that splices will not always be exactly orthogonal in the 
image. In this case, the zipper appears at an angle m Ihe image. The complete row score may 
be obtained by spUtting the image into zones, looking for zippers in liie rows contained in 
each zone and adding zone scores. By using more zones, this system can tolerate splices that 
are more off-angle. For each zone (e.g., eight zones of 512 pixels each), comb sums are 
created which represent the sum of pbcel intensities of each column in a specific pattern. The 
goal is to match the pattern exactly with the spacing expected in the zipper. Fig. 1 1 illustrates 
colunm spacing for comb sums. 

[001571 The algorithm then takes the minimum and maximum sum obtained for each row 
in each zone and calculates a ratio of minimum to maximum. Fig. 12 illustrates the raw 
image (top) and zone scores for four zones per row (bottom). It should be noted that the ratio 
score also may be .teiggered on belt rivets as they appear similar to the zipper patterns of 
splices. 

[00158] Taking the best score (or ratio), fiom each zone in a row. the row score may be 
the sum of each zone score. Fig. 13 illusttates zone scores for four zones per row (top) and 
row scores (bottom). These row scores can be added into a nmning window sum for each 
row. When the running window sum reaches its maximum value, the window is centered on 
the spUce and a detection has occunred. Any maximum that occurs above a certain threshold 
is considered a spUce in the imagery. Fig. 14 illusttates row comb scores (top) and running 
window sum with detection threshold (bottom). 

[00159] Again, the threshold used for detection may be calculated dynamically for 
changing lighting and belt situations. For example, keeping a running average of scores, the 
threshold may be chosen to stay above the running average by about fifty percent (50%). By 
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examining flie number of rows that fall above this threshold (in one group), some false 
positive situations may be eliminated. Detected features that do not have the correct width 
(which is the size of the mechanical splice in pixels) can be discarded as false detection. This 
may occur when the running window sum is noisy and may cross the threshold line a few 
times while climbing or felling a peak. Fig. 15 illustrates results of the algorithm running on 
a test rig with two spUces on a 35-foot piece of belt in a continuous loop. In the figure, row 
scores are shown at the top and running window sums and threshold are shown at the bottom. 

[00160] Anoliier embodiment of a mechanical splice detection algorithm may include 
piano key splice detection. An analogy may be drawn between the belt images and a player 
piano roller with holes that trigger notes from the piano. The raw imagery coming firom the 

belt can be thought of as the player roller with intensity levels representing the holes. As a 

mechanical splice comes past the detector, an event is triggered which registers a higher score 

(that can be used later to detect a splice). 

[00161] By looking at a specific sweep of pixels in a mechanical splice, a unique shape 
that only occurs at flie holes of splices may be identified. Fig. 16 illustrates raw image (left) 
and pixel values with template pattern (right). As shown, the hole pattern fits the template 
pattern fairly well and will score highly. 

[00162] For each pixel, it is necessary to know the sum of intensities of two different 
windows around that pixel. These values may be refenred to as the pattern running sum and 
the whole running sum. Fig. 17 illustrates pattern sum (left) and hole sum (right). Ibe hole 
sum represents the pixels that will be very low if lined up on a hole. The pattern sum 
(subtracting out the hole sum) represents the rest of the pixels in the pattern which will score 
highly on clips where the pixel intensities are relatively high compared to the belt It should 
be noted that unlike the previous mechanical splice detection algorithms, this algorithm 
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examines ihe image data in the vertical (along the motion of travel of the belt) direction and 
liius this ramiing sum must be maintained along the vertical direction. 
[00163] Using the running sums, pixel scores can be calculated indicating how well each 
■ pixel fits the pattern. Fig. 1 8 illustrates raw image Geft) and pixel scores (right). As shown. 
lighter corresponds to a better fit. In one miplementation, pixel scores can be calculated 
using the following formula: 

Pixd Score = j^^-jj-^ 
•where ' 



= Pattern Running Sum 

Sj^ " Hole Rxuming'Simi 

^ Nvanber ofPixels in Fattem Sum 



» Number OfPixels in Hole Smn 

[001641 For each row, tiie pixel scores are summed. The distance ftom the running 
average becomes the row score. Fig. 19 illustrates pixel scores (top), row sums . (middle), and 
final row scores (bottom). Hxese row scores can then be added into a rmming-window smn 
for each row. When the running window sum reaches its maximmn value, the window is 
centered on the spUce and a detection has occurred. Any maximums that occur abpye a 
certain threshold are considered spUces in the imagery. Fig. 20 illustrates row scores (top) 
and running window sum wilh detection threshold (bottom). 

[00165] The threshold used for detection can be calculated dynamically for changing 
lighting and belt situations. For example, keeping a running average of scores, the threshold 
may be programmed to stay above the mnning average by about fifty percent (50%). By 
examining the number of rows that fall above the threshold (in one group), some Mse 
positive situations can be eliminated. Detected features Ihat do not have the correct width 
(which is the size of the mechanical splice and pixels) can be discarded as false detection. 
Hiis may occur when the running window sum is noisy and may cross the threshold line a 
few times while climbmg or falling a peak. Fig. 21 illustrates results of the algorithms 
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running on a test rig with two splices on a 35-foot piece of belt in a continuous loop. In the 
figure, row scores are shown above and running window sums and thresholds are shown 
below. 

[001661 After a mechanical splice has been detected, the BIS 20 may perform mechanical 
splice analysis. A mechanical splice on a coal mining belt is subjected to numerous types of 
stresses. Impact force applied by rollers and scrapers, and heavy load forces produced by the 
loading of coal onto the belt are some of Ihe more common lypes of stresses a mechanical 
splice experiences. Over time, these forces will cause the mechanical splice to break down 
and ultimately fail. When a mechanical splice fails, the belt breaks at the point where the 
mechanical splice was holding two pieces of belt together. As a result of the mechanical 
splice failure, all mining operations that are dumping coal onto the belt must stop until the 
belt is repaired. 

[00167] In the BIS 20, once a mechanical splice has been detected by the system, it is sent 
to the object analyzer. There, it is analyzed for defects and a health score is assigned to the 
mechanical spKce that represents the health of the splice. This health score may be used to 
trigger an alarm (e.g., audio or visual) when the health score falls below a specified safe 
threshold level. The purpose of the alarm is to notify mine personnel lhat a mechanical splice 
is in need of repair. The mine personnel can then manually inspect the mechanical splice 
using the BIS 20 and can decide whether or not to repair the splice immediately or at a later 
time, depending on the state of the splice. Ultimately, this may prevent unexpected belt 
breaks and keep mine operating down time to a minimum. 

■ 

[00168] In order to detect defects, the system must know what a good splice looks like 
compared to one that is foiling. To understand this, several common defects that occur in 
mechanical splices will be described and then a method used to assign a health score to a 
mechanical splice will be described. The methods described below receive an image of a 
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mechanical splice as input and outputs a score representing the health of the splice, areas of 
Ihe splice found to contain defects, and areas of the splice found to be acceptable. One or 
more of these methods may be used to score the mechanical splice. In one implementation, 
several inethods are used with each method outputting^ts own scoring-information. A 
function then combines the results m order to produce a robust final scoring output. 
[001691 A mechanical splice essentially is made up of two rows of metal cUps and a pin. 
In order to join two pieces of belt together, one row of clips is riveted to one piece of belt and 
another row of clips is riveted to the other piece of belt The clips arepulled together such 
that their teeth overlap one another and the metal pin is driven through the hole that is formed 
between the teeth. When tension is appUed to the belt, the metal cUps pull on the pin and 
since tiie two rows of clips pull on the pin in opposite directions, the belt is held together. All 
parts of the splice must remain functional in order for the splice to hold the belt together. If 
any part starts to feil, the mechanical splice weakens and if enough parts fail, the splice will 
not be able to hold the belts together and the belts will break. 

[001701 The following figures illustrate examples of how each part that makes up a spUce 
may appear when it is faUing. Fig. 22 illustrates mechanical splice clips with different types 
of teeth defects. As shown, a clip with a single broken tooth is shown on the left and several 
clips in a bottom row with broken/stretched teeth are shown on the right. Fig. 23 iUustrates a 
mechanical splice with Ming rivets. Fig. 24 illustrates a mechanical splice with an entire 
row of missing cUps. Fig. 25 illustrates a mechanical splice with a few missing cUps. Fig. 26 
illustrates a mechanical spUce with a broken pin. Fig. 27 illustrates a mechanical splice that 
is unzippering because a pin is startmg to slide out. 

[001711 Various analysis methods may be used to assign a health score to a mechanical 
spUce based on the number of defects that have been detected in the spUce. In one 
embodiment, a health score may be based on the primary hole of each clip. This method of 
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scoring focuses on exanaining the holes of the interleaving clips which form a zipper pattern. 
Fig. 28 illustrates an image of a mechanical splice with no defects (top) and a zoomed-in 
image of a splice highlighting the zipper hole pattern farmed by the teeth of the clip (bottom). 
In a mechanical splice with no defects, flie zipper hole pattern is uniform across the entire 
splice. Howevar, m mechanical splices that contain defects, the zipper hole pattern is not 
uniform. 

[00172] This method may include processing the image and finding the zipper holes that 
are contained between the teeth of tiie top and bottom rows of clips that make up the 
mechanical splice. Each located zipper hole is analyzed to determine its bounding box 
region. The size, aligmnent, and similarity of each of the identified zipper hole bounding box 
regions are then used to score the splice based on the uniformity that the zipper holes form 
across the spUce. 

[00173] Fig. 29 illustrates one embodiment of a mechanical splice scoring algorithm. In 
general, the mechanical splice scoring algorithm 50 may process a mechanical splice image 
in order to assign it a score based on analyzing the zipper hole pattern. In one 
implementation, the mechanical splice scoring algorithm 50 may be performed by a BIS 20 
configured to detect a mechanical spHce (step 500), locate belt edges (step 505), set up zones 
(step 510), detect clip height (ste^) 515), detect zipper row location (step 520), construct 
zipper hole locations (step 525), detect candidate clip positions (step 530), assign holes to 
clips (step 535), determine splice assembly (step 540), determine clip occupancy (step 545), 
determine size of each hole (step 550), generate function pair information (step 555), and 
score the mechanical splice (step 560). 

[00174] Fig. 30 illustrates an image of a detected mechanical splice used to describe the 
mechanical splice scoring algorithm 50 (top) and an extracted portion of the mechanical 
splice that contains data between located belt edges (bottom). Detecting the mechanical 
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splice (s1^ 500) may be performed as described above and/or in any other acceptable 
manner. 

100175] Locating belt edges (step 505) may be performed as follows. The image data 
betweai the belt edges is of interest to the system. This step processes the detected 
mechanical spHce-image and determines the unage columns that contain the edge of the belt. 
In one implementation, the belt edge algorithm examines the pixel intensi^ variances of each 
column in the splice image. Areas of low variance ate determined to be noii-belt data as this 
imagery is of the static background and therefore shouldbe fairly constant in intensity. 
[00176] All column variances are sorted in ascendmg order. This sorted list;is .then 
searched to locate a point where the variances between adjacent points takes a relatively large 
step. This step is deemed to be the critical threshold level for classifying columns as 
belonging to either the background or part of the belt. Namely, columns with variances 
above the threshold are classified as belt and columns with variances below the threshold are 
classified as background. Fig. 31 iUustrates sorted column variances of the mechanical splice 
(top) and column variances of the mechanical spUce with mean and threshold (bottom). 
[00177] The belt edge algorithm may use the computed mean variance as the starting 
point to look for the edge of the belt. The first column with a variance above the mean is 
used to search for the left side of the belt The search may step backwards looking for the 
first occurrence of a column with a variance below the threshold level. This column is then 
deemed to be the start of the belt Likewise, the last column with a variance above the mean 
is used to search for the right side of the belt The search steps forward looking for the first 
of a column with a variance below the threshold level. This column is then 



occurrence 



deemed to be the aid of the belt 



[00178] Settmg up zones (step 510) may be performed as follows. A mechanical splice 
may appear at any angle in the detected image depending on how the spUce is installed on the 
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belt and how the BIS 20 is ahgned with respect to the belt. Therefore, it may be necessary 
for the algorithm to handle splices appearing at angles in the imagery which will make Ac 
zipper hole pattern appear at an angle. 

[001791 To account for such an angle, image data contained between the belt edges is split 
up into zones. The greater the number of zones, Ihe smaller the amount of data contained in a 
zone and flius adjacent zipper holes in a zone appear nearly in the same row. The number of 
zones required is detennined on a per installation basis depending on the angle at which the 
splices are appearing in the image. 

[00180] This step constracts the zone boundaries across a belt imagery. The algoritiim 
attempts to create equal sized zones, but may not be able to smce it is constrained to make the 
center column of the image (the boundary point where the image data from Ihe two cameras 



come 



together) a zone boundary point. Fig. 32 illustrates a mechanical splice with eight 



zones. 



[001811 Detecting clip height (step 5 1 5) may be performed as follows. Detecting the belt 
edges limited the image data to be processed in the horizontal direction to the area containing 
Ihe belt This step looks to reduce the image data to be processed further by limiting the data 
to be processed in the vertical direction to only the data containing the mechanical splice. 
That is, this step determines the row location of the top of the top row of clips and the row 
location of tiie bottom of the bottom row of clips. 

[00182] Detecting zipper row location (step 520) may be performed as follows. This step 
locates the zipper pattern in each of the image zones. In each zone, a zipper pattern template 
is slid across each row. For each row, the best template matching location and template slide 
offset are stored. Then, the template matchmg scores are analyzed to determine where tiie 
top and bottom zipper holes are located by determining the peak response of the scores. The 
row(s) containing a peak determine Ihe row location and the slide location and the slide offset 
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of that row determines tiie horizontal offset from the start boundary of the zipper pattern of 
that zone. If two peaks are detected, then the pin is detemiined to be at the local minima 
contained between the two peaks. 

[00183] This step may be based on constructing a vertical edge magnitude image at the 
mechanical splice and using this information to determine the location of the zipper holes. 
However, it is'important to note fliat either the comb or the piano keys method also may be 
used to detect the location of the zippra: holes. 

[00184] Fig. 33 illustrates an image portion of a mechanical spUce (left) and its vertical 
edge magiiitude image (right). As shown, the vertical edge magnitude image of the 
mechanical spUce includes values ranging from negative (dark intensities) to positive (light 
intensities). By examining the shape of the edge magnitudes along a row containing the 
zipper holes, a regular pattern may be seen which can be used to develop a template pattem 
that scores highly when the regular pattem is compared to the template. 
[00185] Fig. 34 illustrates an edge template pattem construction. The template pattem for 
locating the zipper hole pattem is constructed from the user defined geometry of the 
mechanical clips that are on a particular belt. As shown in the figure, the top image is a 
vertical edge magnitude unage along the zipper holes of the mechanical sphce and the middle 
diagram is the template pattem constructed to match the vertical edge magnitude zipper hole 
pattem and can be defined with the user configurable variables provided at the bottom of the 
figure. 

[00186] In each zone, a two-dnnensional template pattem is constructed that is the height 
of the zipper holes tall and is as wide as the width of the zone. This template pattem is 
appUed at several offeet locations in each row. For each row, the offeet that produces the 
maximum response is recorded as well as the maximum response itself. 
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[00187] Fig. 3 5 illustrates maximum template responses for each row in section 3 (top) 
and in section 7 (bottom). The maximum template row response scores are processed to 
determine the location of the peak response. An area around this location is then searched for 
another peak. These two peak locations, if found, are compared to a threshold level which is 
the mean teinplate response times a multiplier. If both peaks are above the threshold, then 
fliey represent Ihe top and bottom zipper hole row locations. If two peaks are found, then the 
pin row location for that section is determined by locating the local minimum contained 
between the two peaks. If only one peak was found, and it is above the threshold level, then 
this indicates that only one zipper row was found and it cannot be determined, yet, if the row 
belongs to the top or bottom row of cUps. If no peaks are found, then there are no zipper 
holes in this section, which can happen if a section contains a portion of a mechanical splice 
with all cUps missing. 

[00188] Constructing zipper hole locations (step 525) may be performed as follows. This 
step takes the row and offeet locations for tiie top and bottom zipper holes and the pin row 
location in each zone and constructs a list of zipper hole center estimates for the top and 
bottom clips. Construction of the top zipper holes list starts in the first section where the first 

I 

r 

hole is placed top zipper hole offset pixels from the start of the boundary of tiie first zone. 
Additional hole centers are added to the list by an amount equal to one clip hole width and 
one clip tootii widtix. This continues until a hole center goes beyond the end of the first zone 
boundary. A similar process is then carried out in each zone continuously adding to the list 
of top and bottom zipper hole center locations. 

[00189] If a zone is encountered in which only one zipper row was detected, its row 
location is examined against neighbor zone locations to determine if it belongs to the top or 
bottom zipper hole list. The missing row of holes is then extrapolated from the nearest 
neighbor in which that row of zipper holes was detected. If the zone is encountered in which 
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no zipper hole locations were located, then hole locations are extrapolated from the nearest 
neighbor in which top and bottom zipper holes were detected. This process -produces a 
complete list of estimated top and bottom center zipper hole locations. Each zipper hole also 
contains information as to where its pinlocation was detected. 

[00190] Once constructed, the list is post-processed to fill in any gaps and to remove any 
redundant holes that may have resulted from: the previous step. This results in a complete list 
of zipper hole center locations for the top and bottom row of clips that span the entire length 
of the detected width of the belt regardless if the clips are installed to the end of .the belt or 
not. 

[00191] Using a template of the size of a single zipper hole wide by a single zipper hole 
high, a small area around each zipper hole is then searched to determine if a better zipper hole 
location can be found. The best template response in the search is then used to update the 
estimated hole center with a true hole location. Differences in estimated and true hole 
locations are noticeable when the splice is at an angle in the image and in areas where flie 
zipper pattern is not continuous in a single row due to some clip defect. 
[00192] Fig. 36 illustrates a portion of a mechanical splice with both the estimated and 
determined to be true zipper hole locations. As shown, the vertical edge magnitude image of 
the mechanical splice is overlaid with the estimated (x's) and the true (squares) zipper hole 
center locations. 

[00193] Detecting candidate clip positions (step 530) may be performed as follows. This 
step uses the list of zipper hole center locations from the previous step, the vertical edge 
magnitude image, and knowledge about the geometry of the clips in order to determine the 
location and style of the clips in the top and bottom rows of the mechanical splice. The terms 
that are referenced in this step are defined as follows. 
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[00194] Fig. 34 defines what is meant by the primary and secondary zipper holes and clip. 
As shown, the figure illustrates a portion of a mechanical splice with primary (P) and 
secondary (S) holes labeled. Primary holes are contained between tiie teeth of a single clip 
while the secondary holes are contained between the teeth of adjacent clips. 
[00195] Fig. 35 defines the different possible clip styles. As shown, the figure illustrates 
examples of various clip edge alignment types based on the tooth that lines up with the edge 
of the clip. In Ihe left image, top clips are right-edge and bottom clips are left-edge aligned, 
hi the right image, top cUps are left-edge and bottom clips are right-edge aligned. 
[00196] The top zipper hole center locations are contained in a list such that they are in 
sequential order firom left to right in the mechanical splice image across the length of the 
detected belt width. Furthermore, the hole locations have been generated such that every odd 
numbered hole is either a primary or secondary hole and every even numbered hole must be 
the opposite hole type. Generating the list in such a manner constrains the problem of 
determining the correct possible location and style of the clips that must be associated with 
the holes. 

[00197] In fact, there are only four possible clip location and style assignments that make 
sense, as shown in Fig. 39 and Fig. 40. Referring to Fig. 39, top row clips - right edge 
aligned templates define primary holes by either even (top) or odd (bottom) numbered zipper 
holes. Referring to Fig. 40, top row clips-left edge aligned templates define primary holes by 
either even (top) or odd (bottom) numbered zipper holes. 

[00198] These figures show templates that are used to determine the location and style 
type of the clips in the top row of the mechanical splice. The dashed lines in tiie templates 
area are shown only to graphically iUustrate that each template is of a particular clip style. 
That is, no actual template matching takes place at the dashed hne locations. The solid black 
Unes in the templates represent areas in which tiie vertical edge magnitude image is expected 
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to contain negative values. The solid gray lines in the templates represent areas in wHch the 
vertical edge magnitude image is expected to contain positive magnitude values. 
[001991 The top zipper hole center locations indicate where the holes are located in the 
vertical edge magnitude image. The geometry of the template is based on liie userrdefined 
geometry of the cUps which is stored m a configuration file. The hole locations are used to 
guide where the template matching occurs in the vertical edge magnitude image. 
[002001 Fig. 41 iUustrates an example of applymg the four possible cUp templates to 
detemiine the location and style of Ihe clips in the top row of the mechanical spUce. As 
shown, the vertical edge magnitude image of the top row of clips is overlaid with each of the 
four possible clip style templates to show where each template looks for aparticular pattern. 
In this case, the first template matches the best and hence the top row of clips is determined 
to be right edge aligned with even numbered primary holes. 

[002011 In Fig. 41, an image is repeated four &nes and each one of the four possible clip 
styles is overlaid on top of the edge magnitude image. Four scores are computed to represent 
how well each template matehes the clip style present in the vertical edge magnitude image. 
Each template score may be computed by summing all of the areas in the vertical edge 
magnitude image where the gray solid lines are located and subtracting fi:om that the sum of 
all of the areas where the black soUd lines are located. The template with the Wghest score 
determines the location and the style of the clips in the top row of the mechanical splice. 
[002021 A similar process is then carried out to locate the bottom cUps of the mechanical 
spUce. Again, the four possible cUp location and style assignments are shown in Fig. 42 and 
Fig. 43. Referring to Fig. 42, bottom row clips - right edge aligned templates define primary 
holes by either even (top) or odd (bottom) numbered zipper holes. Referring to Fig. 43, 
bottom row clips - left edge aligned templates define primary holes by either even (top) or 
odd (bottom) numbered zipper holes. 
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[00203] These figures show templates that are used to determine the location and style 
type of the clips in the bottom row of a mechanical splice. The dashed lines in the templates 
area are shown only to graphically illustrate that each template is of a particular clip style. 
That is, no actual template matching takes place at the dashed line locations. The solid black 
lines in the templates represent areas in which the vertical edge magnitude image is expected 
to contain negative values. The solid gray lines in the templates represent areas in which the 
vertical edge magnitude image is expected to contain positive magnitude values. 
[002041 The top zipper hole center locations indicate where the holes are located in the 
vertical edge magnitude image. The geometry of tiie template is based on the user-defined 
geometry of the clips which is stored in a configuration file. The hole locations are used to 
guide where the template matching occurs in the vertical edge magnitude unage. 
[002051 Fig. 44 illustrates an example of applymg the four possible clip templates to 
determine the location and style of the clips in the bottom row of a mechanical splice. As 
shown, flie vertical edge magnitude image of the bottom row of cUps is overlaid Avith each of 
the four possible clip style templates to show where each template looks for a particular 
pattMU. In this case, the last template matches the best and hence the bottom row of clips is 
determined to be left edge aligned with odd numbered primary holes. 
[002061 In Fig. 44, the image is repeated four times and each one of the four possible clip 
styles is overlaid on top of the edge magnitude image. Four scores are computed to represent 
how well each template matches the clip style present in the vertical edge magnitude image. 
Each template score is computed by summing all the areas in the vertical edge magnitude 
image where the gray solid lines are located and subtracting ftom that sum all of the areas 
where the black solid lines are located. The template with the highest score determines the 
location and the style of the clips in the bottom row of the mechanical splice. 
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[00207] Assigning holes to clips (step 535) may be performed as follows. From the 
previous step, the style and locations of the clips in . both the top and bottom row of the 
mechanical spUce are known. IMs step assigns the.zipper holes in the top and bottom row to 
their respective clips and marks them as either a primary or secondary hole. In one 
implementation the top and bottom clips are analyzed in order to determine how the 
mechanical spUce is assembled and to assign each cUp in the top row with a mate in the 
bottom row. Fig. 45 illustrates eight different possible assembly options. 
[002081 To determine how the splice is assembled, the primary hole . of each cUp in the top 
row is analyzed. For each primary hole in the top row, the algorithm searches for a clip in the 
bottom row whose primary hole is within one and one-half zipper hole widths in the 
horizontal direction. If it finds one, it increments the support score for 45 degree assembled 
if the top hole is located to the right of . the bottom hole; otherwise, it increments the support 

for 135 degree assembled. The assembly style score with the most support is then 
assigned as the assembly style of the mechanical spUce. Tlie algorithm then goes over each 
clip in the top row and assigns it a matching clip mate in Ihe bottom row based on this 
assembly style. 

[00209] Determining clip occupancy (step 545) may be performed as follows. This step 
determines whether a clip is present or not In one implementation, only those candidate 
clips in which a clip is determined to be present are processed. 

[00210] Determining the size of each hole (step 550) may be performed as follows. This 
step analyzes the primary hole of each clip. All holes are first analyzed to detennine their 
height A pass is then made over the holes to determine the median hole height in the top and 
bottom rows of cUps. A second pass is then made over Ihe holes where each hole is 



score 



com 



pared to its respective median hole height If Ihe hole is within some configurable 
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tolerance of the median hole height, then the hole is determined to be free of defects. 
Otherwise, the hole is marked as having a defect. 

[00211] Fig. 43 illustrates an example of how the primary hole height is determined. 
From left to right: raw pixel intensities of a clip mate pair, their vertical edge magnitude 
image, the temperate response of growing each of the top and bottom zipper holes and the 
resultant zipper hole heights overlaid on the raw pixel intensity image. The vertical edge 
magnitude image shows the zipper hole template that is slid over the image in order to 
produce the response shown in tiie graphs. The template contains a positive edge (shown in 
gray) and a negative edge (shown in black) Ew thick and separated by Hw. The summed 
black area is subtracted from the summed gray area to obtain a response at a particular row 

location. 

[002121 Generating functional pair information (step 555) may be performed as follows. 
This step analyzes each clip mate pair to detennine if they make up a functional pair of clips 
or not, i.e., whether or not they are supporting holding the belt together. If the top and 
bottom clips that make up the clip mate pair are both present and their primary holes are both 
determined to be healthy, then the number of functional clip pairs present m the mechanical 
splice is incremented. The total number of ftmctional clip pairs is assigned to be the health 
score of the mechanical splice. 

[00213] Scoring the mechanical splice (step 560) may be perfomed as follows. Fig. 47 
through Fig. 50 illustrate examples of how the scoring algorithm locates various kinds of 
mechanical splice defects. In each figure, vertical lines represent a section boundary line, 
horizontal lines are the location of the pin in a particular section, the smaU x's are Ihe 
estimated zipper hole locations, the boxes are the refined zipper hole center locations, and the 
boxes containing an X represent clips that the algorithm has marked as having a defect Clips 
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that do not contain a primaiy zipper hole with an X-out box are clips that the algorithm has 
detennined to be free of defects. 

[00214] There may be some drawbacks associated with scoring based on analyzing 
primary holes. In particular, mechanical splices appearing at an angle in an image may 
present a problem. The determination of the size of the primary zipper holes assumes that the 
bottom (in the case of the top zipper holes) and the top (in the case of the bottom zipper 
holes) of the hole boundaries are determined by the pin location. The pin location was 
determmed as a result of detecting the zipper hole pattern within each given zone. 
Unfortunately, the pm location in each zone is assumed to appear horizontally in an image. 
In actuality, this is not the case when flie spUce appears at an angle. Therefore, when a zone 
is large enough to encapsulate several mechanical clips and the pin is assumed to be 
horizontal, then flie zipper holes for tiie cUps at the ends of tiie zone automatically have a 
larger size than tiie ones for tiie clips in the middle. This results in a large number of zipper 
holes being labeled erroneously as having a defect The solution to tiiis problem may include 
a step in the scoring process that determines the angle of the spKce in tiie image and using 
this information to account for the above problem. 

[002151 In addition, the zipper holes when filled witii mud may present a problem. When 
tiie zipper holes and teetii get filled or covered with mud, it makes tiie detecting of tiie zipper 
holes difficult as tiie contrast between holes, cUps, or teetii becomes ahnost indistinguishable. 
This is a problem for any scoring metiiod which analyzes tiie zipper holes or clip teetii. The 
solution to tins problem is to combine tins scoring metiiod witii anotiier mefliod based on 
oflier cUp or splice featiire which would make tiie entire scoring process more robust 



some 



and accurate. 

[00216] Another example of a scoring metiiod, for example, is a template matohing 
metiiod. Tins metiiod passes several template matehing filters over flie image in order to 
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identify areas where clips are located in the image. Template filters are constructed to look 
for specific features in the image such as the teeth and rivet patters present on each clip that 
make up the mechanical splice. From the original template filter, additional template filters 
can be constructed to allow for scale and rotation variances of the clips as they appear in the 
hnage. The filtered template mechanical splice image produces an image that contains areas 
with high correlation scores. These are areas where the mechanical splice image data 
matches the template filter well and indicates that a clip is present at this location. Detected 
areas with high correlation matching scores are compared in size, alignment and similarity to 
produce a health score for the mechanical splice. Template filters may be constructed based 
on pixel and edge intensities. Fig. 51 illustrates raw data and edge clips with example teeth 
and rivet edge templates. 

[00217] Another example of scoring may be based on machine learning methods. For 
example, machine learning methods (such as Neural Nets, Support Vector Machines, etc.) 
have been applied to solve object classification problems with great success. A database of 
previously detected mechanical spUces may be manually scored by a human expert and then 
used to train the network. The trained network could then be used to score future detected 
splices. 

[002181 In one embodiment, the BIS 20 may be configured to perform vulcanized splice 
detection. The BIS 20 may perform vulcanized splice detection m addition to and/or 
independent of mechanical splice detection, as described above. In general, a vulcanized 
splice holds two pieces of belt together in a manner different firom a mechanical splice. Just 
as in the case of a mechanical splice, however, a vulcanized splice can fail causing the belt to 
break. When a vulcanized splice breaks, it may be more costly to the mine because it takes 
longer to repair than a mechanical splice which means more belt and production downtime. 
Therefore, it is important to be able to monitor and evaluate vulcanized splices. 
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[00219] Unlike mechanical splices, vulcanized splices generally do not have a feature that 
can be used to easily distinguish it from the rest of the belt. In one implementation, 
performing vulcanized splice detection mcludes marking the ends of vulcanized spUces with 
fiduciary patches, detecting the patches, and extracting the image data containing the 
vulcanized splice portion of the belt located between adjacent patches. 
[00220] Fig. 52 illustrates one embodiment of a fiduciary patch design. In this 
embodiment, the patch is 8 inches high by 8 mches wide and includes a checkerboard pattern 
centered within the patch and a circle located at the center of the patch. The checkerboard 
pattern is 7.5 mches per side and each checkerboard square is 0.5 inches per side. 
[00221] In general, the checkerboard pattem can be easily distinguished from any other 
object on the belt, including the belt itself. The size of the checkerboard squares closely 
matches the size of a mechanical splice zipper hole width so that a single algorithm may be 
implemented to detect both mechanical splices and fiduciary patches. The size of the patch 
distinguishes the patch from a mechanical splice. The circle in the middle of the patch 
enables the exact center of the patch to be located in order to perform accurate measurements 
between patches. 

[00222] Fig. 53 illustrates one embodiment of a splice detection algorithm 60 that may be 
implemented by the BIS 20. hi general, the splice detection algorithm 60 may include 
detecting a fiduciary patch and/or a mechanical splice (step 600), classifying the fiduciary 
patch and/or the mechanical splice (step 605), extracting the vulcanized splice and/or 

m 

mechanical splice (step 610), obtaining detection and classification results (step 615), and 
calculating a distance between patches (step 620). hi one implementation, the splice 
detection algorithm 60 enables the BIS 20 to reUably detect both mechanical spHces and 
fiducial patches (both referred to as "objects") while ignoring the rest of the belt. Once 
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detected, the BIS 20 classifies a detected object as either a mechanical splice or a fiduciary 
patch. 

[00223] Detecting a fiduciary patch and/or a mechanical splice (step 600) may be 
performed as follows. In genraal, the amount of strong edges concentrated in small areas 
within the mechanical splice and fiduciary patch make them stand out with respect to the rest 
of the belt. The detection algorithm 60 exploits this fact by examining the image data of the 
belt looking for areas of high concentration. 

[00224] Fig. 54 illustrates a block diagram showing the data structures and computation 
involved in computing an edge score for each raw image row. The edge score is used to both 
detect and distinguish between the mechanical splices and the fiduciary patches. 
[00225] To measure the amount of edge information contained at a particular pixel 
location in the raw image data, a gradient value at that pixel location is computed. The 
gradient score takes advantage of the fiduciary patch pattern (e.g., checkerboard pattern) in 
order to maximize the gradient score at a pixel that is part of the fiduciary patch. The 
gradient score computation is shown in Fig. 54. As new image data is captured, it is placed 
in the live belt image ring buffer. A gradient score is computed for each pixel of the new 
image data in the live belt image ring buffer and is stored in the gradient image ring buffer. 
[00226] As the gradient image is computed row-by-row, a running sum is maintained for 
each pixel column, as shown in Fig. 54, and stored in the gradient column sums ring buffer. 
The size of the running column sum window is equal to the size of the fiduciary patch, 
therefore, each pixel in each row of the gradient column sums ring buffer is a measure of 
edge information, and a measure of how well that column matches the fiduciary patch pattern 
(e.g., checkerboard patter) on the belt over the past fiduciary patch inches. 
[00227] After each row of the gradient colmnn sums ring buffer is computed, it is 
processed by applying a window sum operator over the row in order to compute scores for 
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detection and classification' of mechanical splices and fiduciary patches. As shown in Fig. 
54, a window the size of the fiduciary patch is passed over each gradient column sums ring 
buffer row. As this is done, severd items are computed and stored-in the window sums ring 
buffer for each row including the magnitude of the largest window sum, the column location 
of the largest window sum, and tiie mean window sum response for the entire row. Each row 
in the window sums ring buffo: therefore contains the best location within the raw image data 
that matches the fiduciary patch pattern and a magnitude score which represents how well it 

ft 

matches &e fiduciary patch pattern. 

[00228] Fig. 5 5 and Fig. 56 illustrate example responses of the window sum response 
across a gradient column sums row for a fiduciary patch and a mechanical splice. Referring 
to Fig. 55, a horizontal profile of window sums for a fiduciary patch is shown. Referring to 
56, a horizontal profile of window sums for a mechanical splice is shown. 
[00229] As the window sums ring buffer is computed row-by-row, a runnmg sum is 
maintamed of the magnitude response of each row. In one implementation, tiie size of the 
running sum window may represent approximately 50 feet of belt In general, this is large 
compared to the size of the mechanical splice (about 4.75 inches) or a fiduciary patch (8 
inches) which allows the algorithm to compute a good average score that represents the belt. 
This running average score is multiplied by a user configured scaling fector in order to 
determine a detection threshold level. 

[00230] As the window sums ring buffer is computed row-by-row, each magnitude score 
is compared against the running detection threshold level. If the magnitude level of a row is 
above tiie detection threshold level, it is recorded as the start of an object and an object 
tracking flag is set. While tracking an object, tiie algoritimi keeps track of the row location in 
the live belt image ring buffer and the location within that row that produces the highest 

47 



wo 03/059789 PCT/US03/00966 

magnitude score (i.e., the location that matched the fiduciary pattern the best), which may be 
referred to as the center row. 

[00231] Object tracking continues until a row magnitude score drops below the detected 
threshold. This row is recorded as the end of the object, object tracking is turned off, and 
object detection is completed. At this point, the object is ready to be classified and may be 
ready to be extracted from the live belt image ring buffer and placed into the analyzer image 
ring buffer queue to be analyzed. 

[002321 Classifying the fiduciary patch and/or the mechanical splice (step 605) may be 
performed as follows. Referring to Fig. 55 and Fig. 56, it can be seen that the mean response 
for the mechanical splice is higher than that of the patch because the edges contained in the 
mechanical splice (especially those produced by the clip teeth and rivets) occupy a larger 
portion of the image width than those of the fiduciary patch. A classification score takes 
advantage of this difference by normaUzing by the mean window sum response within a row 
and may be defined as: 

Let MeanWS - Mean(WindowSum) 

and MaxWS = Max WindowSum 

then ClassificationScore = (MaxWS - MeanWS)/MeanWS 

where ClassificationScore may be used to classify the detected objects as being 
either a mechanical splice or a fiduciary patch. 

[00233] After the mean response is computed for a row in the window sums ring buffer, 
the classification score for the row is computed by the above formula. 

[00234] As the window sums ring buffer is computed row-by-row, a running sum is 
maintained of the classification score response of each row. hi one implementation, the size 
of the running window sum window is large enough to represent approximately 50 feet of 
belt. In general, this is large compared to the size of a mechanical spUce (about 4.75 inches) 
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or a fiduciary patch (8 inclies) which aUows the algorithm to compute a good average score 
that represents the belt and mechanical spHces. This running average score is multiplied by a 
user configured scaling fiictor in order to determine a classification thresholdlleVel. 
[00235] Once an object is detected, the classification scores of the rows in the window 
sums ring buffer betwerai the start and end of the object are examined to determine what type 
of object has been detected. If the classification scores for an object are above the 
classification threshold level, then the object is classified as a fiduciary patch. Otherwise, it 
is classified as a mechanical splice. 

[00236] If the object is a mechanical spUce, it is ready to be extracted firom the Uve belt 
image ring buffer into ihe analyzer ring buffer where it wUl be analyzed for defects. 
However, if the object is a fiduciary patch, the algorithm must process the patch fiirther to 
determine if it is part of a Vulcanized splice or point-of-origin patch pair and whether it is the 
head or tail patch. 

[00237] If the algorithm has not detected a head patch yet, which by defeult it has not at 
the start of the application, then this patch is mariced as the head patch; The next detected 
patch is assumed to be the tail patch and its distance &om the previous patch (the head) 
determines how the algoritiim proceeds. 

[00238] The distance between the pair of adjacent patches classifies the patch pair as 
either the point-of-origin of the belt, a fiducial splice, or no object. The classification may be 
performed as follows. If the distance between the patches is less than the user defined 
maximum distance between the point-of-origin patches, then the patches are classified as 
being the point-of-origin of the belt If the distance between the patches is greater than the 
user defined maximum distance between the point-of-origin patches and less than the user 
defined maximum distance between a pair of patches lhat define a vulcanized splice, then the 
patches are classified as being part of a vulcanized splice. If tiie distance between the patches 
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is greater than the user defined maximum distance between a pair of patches that define a 
vulcanized splice, then the pair patch is ignored. 

[00239] If the pair patch is determined to be part of a vulcanized splice, then detection of 
a vulcanized splice has taken place and the algorithm is ready to extract the splice from the 
live belt image ring buffer into the analyzer ring buffer where it will be analyzed. If the pair 
patch is determined to be the point-of-origm of fee belt, feen the algorithm informs the table 
of contents identification manager feat fee point-of-origin has been detected and of its 
location. Regardless of fee pair patch classification, after fee pair has been processed, fee tail 
patch will become fee head patch and fee algorithm waits for fee next patch to be detected. 
Once fee next patch is detected, fee same steps as above are performed. 
[00240] Whenever a mechanical splice is detected by the system, the algorithm purges 
any information feat is stored in fee head patch data structure and clears fee head patch 
detected flag. This is because fee algorithm assumes that feere cannot be a mechanical splice 
located between any pair of patches. In this case, fee algorithm classifies fee next detected 
patch as fee head patch and again proceeds as above. 

[00241] Extracting a mechanical splice and/or a vulcanized splice (step 610) may be 
performed as follows. Once the object has been detected and classified, fee object is 
extracted from the live belt image ring buffer and added to fee object analyzer ring buffer. 
The type of object determines how fee image data extraction takes place. 
[00242] Extraction of a mechanical splice is performed by extracting fee image data 
located around fee center row location determined while tracking fee object in fee detection 
phase of fee algorithm. The image data extracted may include the data located a fixed 
number of rows before and after fee center row location so that fee entire mechanical splice is 
sure to be captured in fee extracted image data. Fig. 57 illustrates a fiducial detector estimate 
of mechanical splice center used to extract a splice. 
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[002431 Extraction of a vulcanized splice is done by extracting image data located 
between the head and tail fiduciary patches. The image data extracted may include data 
located a fixed number of rows before the center row of the head patch and after the center 
row of the tail patch so that the entire vulcanized splice and botii fiduciary patches are sure to 
be captured in the extracted image data. 

[002441 Obtaining detection and classification results .(step 620) may be performed as 
follows. Fig. 58 illustrates algorithm detection and classification score results for a 35-foot 
section of belt lhat contains five fiduciary patches and two mechanical splices. As shown, the 
detection graph window indicates Ihe detection score response of the algorithm over the 
entire section of belt and the running detection threshold level. As seen in this graph, the 
detection score response of each one of the patches and mechanical splices is above the 
detection threshold level which indicates that all objects have been, detected by the algorilhm. 

I 

[002451 As shown, the classification graph window indicates the classification score 
response of the algorithm over the same section of belt as well as the classification threshold 
level. As seen in this graph, the classification score of each fiduciary patch is above the 
classification threshold level while the classification score of each mechanical splice is below 
the threshold level. This indicates that each fiduciary patch has been correctly labeled as a 
fiduciary patch while each mechanical splice has been correctly labeled as a mechanical 
spUce. 

[00246] Calculating a distance between patches (step 620) may be performed as follows. 
The length of a vulcanized sphce is defined to be the distance between the center of the head 
and taU fiduciary patches that mark the boundaries of the vulcanized spUce. By monitoring 
the length of the vulcanized splice over time, the system can determine how much the 
vulcanized splice is stretching. The amount of stretch can flien be used as an indicator for 
alerting an operator (e.g., via audio or visual alarm) when a vulcanized splice may be in 
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danger of failing so that the operator can schedule to have the splice repaired before it breaks. 
The following describes various methods for locating Ihe center of the fiduciary patches and 
for defining the length of the splice. 

[002471 hi one implementation, the algorilhm for detecting the center of a fiduciary patch 
has multiple stages including determimng a detector estimate, determming a border stripes 
estimate, and determining the center of the circle, hi general, the goal of each stage is to use 
the knowledge of Ihe location estimate of the center of the patch produced by the previous 
stage(s) and improve upon it by detecting some other feature of the patch that helps to refine 
the estimate. 

(002481 Obtaimng a detector estimate may be performed as foDows. As Ihe wmdow sums 
ring buffer is computed row-by-row, each magnitude is compared agamst the ruraiing 
detection threshold level. If a magnitude level of a row is above the detection threshold level, 
it is recorded as the start of an object and an object trackmg flag is set. While trackmg an 
object, the algorithm keeps track of flie row location in the Uve belt unage ringbuffer and the 
location withm that row that produced the highest magnitude score (i.e.. the location that 
matched the fiduciary pattern the best), which may be referred to as the center row. Object 
tracking continues until a row magnitude score drops below the detection threshold. This 
row is recorded as Ihe end of the object, object tracking is turned off. and object detection has 
taken place. 

[002491 Obtammg a border stripes estimate may be performed as follows, hi this stage, 
the detector estimate may be refined by findmg the half-mch borders aromid Ihe pateh This 
may be particularly usefiil when part of the pateh is occluded, missing, or damaged. The 
location of the borders are used to compute the location pf the center, hi one implementation, 
obtaining a border stripes estimate includes the steps of findmg the angle A of rotation and 
the center of mass, rotating Ihe unage of the pateh by the angle A, finding a horizontal and 
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vertical bolder of the rotated patch, estimating the center using the detected borders and 
center of mass, and rotating the center by angle - A to go back.to the original image 
coordinates. 

[00250] Finding the angle A of rotation and the center of mass may be performed as 
follows. When a fiduciary patch is vulcanized onto the belt,.it will most-likely appear at 
some rotated angle in the captured image data. In general this angle may be firom,-45 to 45^ 
Detecting the borders of the patch is much easier when the patch is not rotated because the 
borders are aligned vertically with the image columns and horizontally.with the image rows. 
This step determmes Hie angle at which the patch is rotated in the image in order to rotate the 
patch by iiris angle so that it becomes square with the image columns and rows. 
[00251] For a fiduciary patch pattern (e.g.. checkerboard pattern), the sides may produce 
very strong edges in the image. The edges belongmg to the top and bottomland to the left and 
right sides of each square forin two major orientation angles which are perpendicular to each 
other. The algorithm takes advantage of these patch properties to detamine Ihe two 
orientation angles using an edge angle histogram. 

[00252] Fig. 60 iUusttates pseudo code for computing an edge angle histogram and center 
of mass. Tlie strength (or magnitude) of an angle of an edge maybe computed using the 
horizontal and vertical gradients by using the filters illustrated in Fig. 6 1 , As shown in the 
figure, a vertical gradient filter and a horizontal gradient filter may be used to compute the 
magnitiide and angle of edges within a fiduciary patch. 

[00253] Fig. 62 illustrates an edge angle histogram for the patch image. In this figure, the 
patch is rotated by 15 degrees which is why a peak at 15 degrees and another at 105 degrees 
. The small peak at 90 degrees corresponds to the edge where part of the patch is torn. 
[00254] Since the major angles of the fiduciary patch pattern (e.g., checkerboard pattern) 
ire perpendicular, the two-peak histogram may be combined into a one-peak histogram as 
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shown in Fig. 63. As shown in the figure, a histogram of perpendicular edge angles for the 
patch image may be obtained by adding histogram values between 0-90 with their offset 
counterparts between 90-180. The maximum of this one-peak histogram is the angle of 
rotation A. 

[002551 Rotating the hna^ of the patch by angle A may be performed as follows, hnage 
rotation may be achieved by multiplying the image pixel coordinates wifli a rotation matrix: 

Coordinates = pC Y]' 
RotationMatrix = [cos(A) 8in(A)] 

[-sin(A) cos(A)] 
RotatedCoords = RotationMatrix* Coordinates 
[002561 Fig. 64 illustrates a patch rotated so it is square to the image plain using the peak 
angle in Ihe histogram. As shown, the center is estimated using flie detected borders of the 
patch. On the left, the original rotated patch with the center of mass estimate is shown as 
dashed lines and border detector estimate of the center of the patch is shown as solid white 
cross-hair with small black cross. On the right, the patch rotated by a rotation angle A with 
detected borders is shown as dashed lines and center estimate is shown as solid white lines. 
[002571 Finding a horizontal and vertical border of the rotated patch may be performed as 
foUows. Once the patch is square on the unage. the horizontal white border can be found by 
taking the sum of adjacent rows of pixel values (number of rows is tiie thickness of the stripe, 
about half-inch or 25 pixels high). The white border gives high values for the sum and the 
row where the highest sum occurred is the location of the horizontal white border. Similarly, 
the vertical border can be fomd using Ihe same melhod for processing the columns of the 
image. Referring again to Fig. 64, the two dotted lines in the right image indicate the two 
detected border stripes. Only one horizontal and one vertical border are needed to locate the 
center. 
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[002581 Estimating fhe center using detected borders and the center of mass may be 
perfonned as folioWs. The center of mass computed in the first step is used to.teU which 
quadrant the center of the patch is located with respect to the intersection pomt of the 
detected horizontal and vertical borders (point-of-origin of borders). The quadrant in which 
the center of tiie patch is located tells the algorithm how much to add/subtract from tiie pomt- 
of-origm coordinates of the borders in order to compute an estimate of the center of the patch. 
The amount to add/subtract to get the estimated center of the patch is a function.of the patch 
dimensions. In cases where tiie current patch pattern is a square, half .the size of the, pat^^ 
the correct amount to add/subtract to tiie point-of-origin of fhe detectedborders. 
[002591 Refening again to Fig. 64, the dotted cross-hair in the left image shows the 
compute center of mass. Using the two detected border stripes (dashed lines m right image) 
and the center of mass, the center of the patch can be projected by addm&half tiie height of 
tiie patch and subtiacting half tiie widtii of tiie patch to get an estimate of tiie center of tiie 
patch row and column location (white cross-hair in right image), hi cases where fliere is 
partial occlusion of tiie patch, flie metiiod canbe very effective in locating a feirly accurate 
estimate of the center of tiie patch. 

[00260] Rotating tiie center by angle -A to go back to tiie original image coordinates may 
be performed as follows. The found center is still in tiie rotated coordinates. The center is 
retimed to tiie original coordinates by rotating tiie estimated center coordinates in tiie 
opposite direction given by tiie rotation angle -A. 

[002611 After obtaining tiie border stripes estimate, tiie location estimate of tiie center of 
tiie patch may be refined furtiier by detecting tiie center of tiie circle. Ihe circle in tiie middle 
of tiie fiduciary patch marks the exact center of tiie patch. Detecting tiie center of tiie circle 
may be performed as follows. In one implementation, different algoritimis may be used to 
search a small area around tiie border stripes estimate from flie previous stage to look for tiie 
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circle and its center. For example, one algorithm that may be used is based on binary image 
morphology. Another algorithm that may be used employs template matching to detect the 
center of the circle. 

[002621 The binary morphology center of circle detection method may locate the center of 
the circle by binarizing the image, dilating the binary unage, labeling the connected 
components, and finding the connected component which matches the area of the circle. 
[00263] To binarize the image, a small image area around the border center estimate is 
extracted. A histogram ofthe pixel intensities ofthe sub-image is computed. The histogram 
is then searched for a pixel intensity threshold level to use to convert the gray-scale unage 
into a binary (black/white) image so that roughly 60% ofthe pixels will be bmarized to black 
and 40% to white. This percentage is exemplary only and is based on the fiduciary pattern 
design of black and white squares and Ihe feet that the border center estimate will be located 

the patch. Therefore, ideally the percentage spUt should be 50-50 but using the split as 60- 
40 allows for occlusions. Determining the threshold level in this manner makes it dynamic. 
That is. the threshold level is insensitive to Ughting conditions. Alternatively, the threshold 
could be set as the mean gray value of the sub-image. 

[002641 Fig. 65 illustrates locating the center of the circle using binary image 
morphology, hnage a is a binarized image of Image c. Image b shows connected 
components. Image c shows center of mass of circle (black cross-hairs) location drawn on 
top ofthe original fiduciary patch image. 

[002651 To dilate the binary image, each white pixel in the binary image is grown using a 
diamond stmcturing element Fig. 66 illustrates one embodiment of a structuring element 
used in dilation operation. As shown, the origin is the center pixel. 
[002661 The purpose of dilation is to connect all the white squares to each other (making 
them one big connected component) while leaving the white circle unconnected to any other 
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white object The diamond shape may be used because it does not allow the circle nor the 
comers of the neighboring squares to grow toward each other. To further insure that all of 
the squares are connected, a one-pixel-thick white line inay be placed at the binary image 
border before dilation. 

[00267] To label the cozmected components, adjacent white pixels may be lumped 
together once the sub-unage has been dilated. In one implementation, an 8-connectivity 
operator may be used to form a list of connected components of the image. Referring to 
Imageb of Fig. 65, the dilated image of binary Image a is shown, where all of the connected 
components are designated as different gray-scale values. It should b^ noted that the squares 
coimect to each other, while the circle is isolated. 

[00268] To find the connected component which matches the area of flie circle, the area of 
each connected component may be examined to determine if the circle is present in the sub- 
image. In one implementation, the imaging resolution of the system is 50 pixels/inch. At this 
resolution, the algorithm expects the half-inch circle to have a radius of 12.5 pixels in the 
image. When dilated using a 3x3 structuring element, the radius grows to 13.5, thus the 
expected circle area becomes 573 pixels (PI* Radius = 3.14*13.5). 
[00269] The area of each connected component is computed and compared against the 
expected circle area. A connected component is labeled as a circle if its area is within some 
range of the expected area of the circle. In one embodiment, the error range may be +/- 150 
pixels. If multiple connected components are labeled as circles or if no connected component 
is labeled as a circle, then the algorithm returns the border center estimate as the estimate of 
the center of the patch, 

[00270] To compute the center of mass of the circle, the center of mass of the connected 
component labeled as a circle gives an estunate of the center of the circle and thus the center 
of the patch. The center of mass of tiie circle may be computed by averaging the row and 
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column coordinates of each of the pixels in the connected component list of the circle. The 
center of mass coordinates of the circle are then returned as the refined estimate of the center 
of the fiduciary patch. Referring to Fig. 65, Image c shows the origmal sub-image. The 
dotted cross-hau: is flie estimate firom the previous stage and the solid white cross-hair (with 
the black center cross) is llie circle center of mass estimate of this stage. 
[00271] Another algorith for detecting the center at the circle may use template matching. 
In one implementation, the template matching center of circle detection method may be 
performed by binarizing the image, convolving a template over die image, and evaluating 
template matching scores. In general, binarizing the image may be performed as described 

above. 

[00272] To convolve a template over the image, a template image pattern is convolved 
the binary sub-image. The result of this step is a sub-image wifli pbcel scores that 



over 



represent how well that pixel location matches the template image. Fig. 67 illustrates an 
example of a circle template. As shown, dashed lines represent borders of the template. 
[00273] To evaluate template matching scores, tiie best matching template location is 
found within the template matching score image. Hie highest score represents the best 
matching location. To determine if tiie center is present at this location, the template 
matching score is compared against a matching threshold. The matching threshold is selected 
such that the template matching score at this location must match the template by at least 
50%, that is, if the template is 40x40 pixels in size, then the score must be at least 40x40 0.5 
= 800. If the score is above the threshold level, then this location is retimed as tiie refined 
estimate of the center of the fiduciary patch. Otherwise, the estimate of the previous stage is 
returned. 

[00274] Fig. 68 illustrates an example of the fiducial algoritiim detecting a highly- 
occluded fiduciary patch. Fig. 69 Ulustrates an example of the center of patch detector 
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locating the center of the patch. In this case, the circle of the patch is occluded and the center 
of the patch is the estimate by the border detector stage. . - 

[00275J La one implementation, the-BIS 20 may pafbrm object identification. The BIS 
20 may perform such object idratification as part of, in addition to, and/or independent of 
performing splice detection. 

{00276J Each belt in a mine may-contain any number of objects where an object may be a 
mechariicsil-or viilcanized spUce, a whole, a flapper, etc. The number of objects arid their 
location-on a belt may be unique to each belt The BIS 20 may track each .object and its 
location on the belt by assigning each detected object a unique idaitification tag. Techniques 
for assigning identification tags and tracking objects are discussed below. 
[002771 In one implementation, object identification may include manual object 
configuration. In general, a user may specify the number of occunences of a particular object 
on the belt which would be deemed the reference object. The first object of this type detected 
by the system would act as the point-of-origin on the beU and all object indexes would be 
assigiied identification tags with respect to this origin. 

[00278] Assuming good object detection, object identification tags may be assigned to the 
running count of each individual object. When the referenced object has been detected for 
the user configured number of times, all counts would reset so that all of the objects would 
maintain the same identification tag with respect to the point-of-origin. 
[00279] In implementation, the user may have the choice of setting either the number of 
mechanical or vulcanized splices on a particular belt, for example. The first reference object 
detected by the system is deemed the point-of-origin on the belt and all object identification 
tags are with respect to that point-of-origin object. Once the point-of-origm is detected, each 
object type receives an identification tag in sequential order. Every time the reference object 
has been detected for the user configured number of times, all counts are reset and the 
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detected objects on the current belt revolution will again receive identification tags in 
sequential order. 

[00280] If the BIS 20 includes an encoder, then the BIS 20 may position stamp the 
location of each object This information may be used to track each object through the 
graphical user interface display as to the distance the object is fi:om the BIS 20 and to 
estimate the amount of time before the object is back at the BIS 20 at the current belt speed. 
[00281] In one implementation, object identification may include installing a fiduciary 
point-of-origin on the belt. For example, a fiduciary point-of-origin can be installed on each 
belt to act as ttie zero reference point of the belt The system may detect the point-of-origin 
and use it to assign identification tags to each object that is detected on the belt Each object 
type may receive an identification tag in sequential order with respect to the reference point 
which would uniquely identify the object 

[00282] In implementation, detected objects may receive a valid identification tag after 
the point-of-origin is detected. Once the pomt-of-origin is detected, each object type receives 
an identification tag in sequential order. Every time the point-of-origin is delected, the object 
identification tag numbers are reset and the detected objects on the current belt revolution 
will again receive identification tags in sequential order. 

[00283] If Ae BIS 20 ificludes an encoder, then the BIS 20 may position stamp the 
location of each object This information may be used to track each object through the 
graphical user interfece display as to the distance the object is &om the BIS 20 and to 
estimate the amount of time before tiie object is back at the BIS 20 at the current belt speed. 
[00284] In one implementation, object identification may include using a belt pattern. In 
^end, the distances between objects on a belt are not uniform in length. Assuming good 
object detection, the BIS 20 may use the pattem of belt lengths to uniquely identify objects 
after a couple of loops of the belt Table 1 shows an example of using a belt pattem. The 
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numbers in the table correspond lb distances hetweeii detected objects on a belt After the 
pa:ttem repeats for amunber of cycles, the pattern can^e detected and used to assign .unique 
idraitification tags to the objects according to the pattern. 




TABLE 1 



[00285] In one implementation, object identification may use a Z-leiigth algorithm. An 
object such as a spUce, for example, joins two pieces of rubber together to make up part of 
the belt Given an accurate encoder measurement of belt position, good object detection, and 
a belt assembled from non-uniform lengths of rubber, two lengths may uniquely define each 
object Table 2 shows an example of using a 2-length algorithm. The distance each object is 
from its neighbor object is used to determine the object pattern on Ihe belt. After the pattern 
repeats for a number of cycles, thepattem can be detected and used to assign unique 
identification tags to the objects according to the pattern. It should be noted that this 
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algorithm can be extended to look at N-neighbors which would make the pattern detection 
more robust and could also allow the algorithm to detect objects being added or removed 
from the belt and to handle false object detection problrais. 



Distance to Previous 


Object Type 


Distance to Next 
Obiect 


ID 


400 


vulcanized splice 


500 


unknown 


500 


mechanical splice 


450 


unknown 


450 


mechanical splice 


475 


unknown 


475 


vulcanized splice 




unknown 










400 


vulcanized splice 


500 


VI 


500 


mechanical splice 


450 


Ml 


450 


mechanical splice 


475 


M2 


475 


vulcanized splice 




V2 



TABLE 2 



[00286] In one implementation, object identification may include obj ect image 
correlation. In general, object imagery does not change drastically between successive 
collected images. Assuming tiie images are consistent enough, image correlation could be 
used to compare new images against previously collected images. High correlation scores 
could be matched and identification tags would be assigned appropriately. 

100287] In one implementation, object identification may include using belt and/or splice 
width. The mechanical splice images collected generally do not have uniform widths of belt 
or clips. Often, the splice installation procedure includes trimming the belt to prevent 
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catcKing an edge on the belt support structure. Assuming the widths of the trimmed belt and 
splices are unique enough, lliese numbers could be used to identify a splice. 
[00288] In one implementation, object identification may use object analysis results. The 
system is scoring each of the detected objects, that is, assigning a health^score to each object 
and recording the location and type of defects. Knowmg the "fingerprinf of each object will 
add to the unique identification of a particular object For example, a new detected 
mechanical splice with zero missing clips could not be confused with a previously collected 
mechanical splice that had four missing clips. - 
[00289] Fig. 70 illustrates one embodiment of a Graphical User hiterface (GUI) 70 that 
may be displayed by the BIS 20. The GUI 70 may be presented to a user through the, UI 21 3 
and/or on a iemote device, for example.' In general, the GUI 70 may be used to control, 
display and/or algorithm variable settiings. 

[00290] As shown, the GUI 70 includes an object image area 700 for displaying the 
objects detects by the system. Tlxe GUI 70 also includes object information fields 701. In 
general, the object information fields 701 may provide various pieces of information about 
the object cunently being displayed in the object image area 700. 
[00291] In one implementation, the object information fields 701 may include an image 
and ID field that states the current object nmnber being displayed, the total number of objects 
that have been detected by the system, and/or the identification tag assigned to the current 
object bemg detected. Ihe object information fields 701 also may include a return field 
informing the user how many feet and how much time at the current belt speed before the 
current object being displayed gets back to the BIS 20. Ihe object information fields 70 1 
may include a past field informing the user how many feet past the BIS 20 the current object 
being displayed is located. The object information fields 701 finrther may include an 
analyzed score field informing the user of the analyzed results for the current object being 
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displayed. The object infonnation fields 701 may include a time field informing the user of 
the date and time the current object being displayed was detected by the system. 
[00292] The GUI 70 may include zoom controls 702. In general, the zoom controls 702 
enable a usar to zoom in and out on the object being displayed by using the plus/minus 
buttons. In one implementation, the maximum zoom in level is 400% and the out level is 
25%. 

[002931 The GUI 70 also may include manual controls 703. Li general, manual control of 
viewing detected objects is provided to the user through the previous and next buttons. The 
next button will go to the next detected object and tiie previous button will go to the previous 
detected object. How far a user may go back may be limited to the number of items in the 
loop length which is defined in Ihe general tab. If the loop length is 100 and the total number 
of objects being displayed is 1000, for example, then the system may only allow the user to 
view objects 900-1000. 

[00294] The GUI 70 may include auto update modes 704. In one embodiment the user 
may enable one of two possible auto update modes by clicking on either the current or loop 
button. When active, the buttons will appear pushed in. To disable either of the auto modes, 
a user can click the button agam so it appears pushed out, or click on the stop, next, or 
previous button. The current mode, when enabled, automatically updates the object image 
and information area with fee most recent detected object information. In one 
implementation this may occur at a rate of once every four seconds. The loop mode, when 
enabled automatically loops over a list of previously detected objects. The amount of objects 
to loop over and how long to wait before going to the previous object can be set under the 
general tab. When the end of the loop list is encountered, the system may automatically jump 
to the most recent detected object and again may start looping back to previously detected 
objects. 
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[00295] The GUI 70 includes cursor location 705 informing the user where the cursor is 
located within the object area. The cursor location 705 may be used to, for example, measure 



features within the object image. 



* . ■ 
"1 ' 



[00296] The GUI 70 may include a lock mode 706. The user may enable ^the lock, mode 
706 to indicate to the BIS 20 that only images of the^current object bemg -displayed are to be 
viewed. If the user clicks the previous or next button, or has current or loop mode enabled, 
the object image and mformation areas wiU be updated only with previously detected 
occurrences ofthesame object tiiatis being. displayed. Viewing.multiple images of a 
displayed object may be used to monitor the rate of degradation of an object. In one 
implementation, multiple images of the same object may be viewed as a movie, for example, 
showing changes in the object over time. 

[00297] The GUI 70 also may include belt information fields 707 and a diagnostic display 
area 708. The belt information fields 707 may display the current belt length and speed. The 
diagnostic display area 708 may display status information as to the state of the system and 
any errors that have been encountered. 

[00298] The GUI 70 may include a console^button 709 and a confi^ation button 7 10. 
The console button 709 may open a main console wmdow including error and debug 
mformation logged by the BIS 20. The configuration button 710 allows a user to determine 
how various algorithms work, which algorithms to run, and how to display objects on the 
. The user may view or change these settings by either cUcking on the configuration 



screen 



button 710 or by pressing the F2 function key. 

[00299] Fig. 7 1 illustrates a configuration interface display 80 fliat may be implemented 
by the BIS 20. In general, there are numerous configuration settings that allow the user to 
determine how various algorithms work, which algoritimis to run, and/or how to display 
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items on the screen. As shown, the configuration interface display 80 includes a camera 
configuration tab 800 for configuring various camera settings. 

[00300] In one implementation, the camera configuration tab 800 includes an exposure 
rate field 801 . This field may control the amount of time the pixels are exposed to the light in 
order to gather information of the scene being analyzed and/or controls the shutter speed of 
the cameras. In one implementation, this field is in Hz or 1/seconds. In geosxal, this value 
should be as fast or fester tiian the maximum digitizing rate that tiie BIS 20 is likely to use on 
any given belt. This will allow one setting to be used over all belt speeds which will make 
the lighting exposure independent of belt speed. This value, generally should not be set to a 
value lower than the digitizing rate. 

[003011 The camera configuration tab 800 also may include a pixels per hich on belt field 
802. This field may be configured by liie user for every installed system to the number of 
pixels per inch that the Systran is seeing at the current installation height. This variable 
generally is dependent on the height the cameras are firom tiie belt, the resolution of the 
cameras, and the focal length of the lens being used in the system. 
[00302] One way to determine this value is to have a system detect a mechanical splice 
and then measure the widtii of a clip in the object viewing area. The value is obtained by 
taking the measured width of one of the clips in the splice that was detected and dividing flie 
pixel width by the true width. 

[00303] The camera configuration tab 800 may include a captured image count field 803 . 
This field may represent the number of captured fiames that have been captured by the 
digitizer card and have been sent to the BIS 20 to be processed since the start of tiie 
application. In general, tiiis field provides a statiis to make sure the system is captining 
images properly. 
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[00304] The camera configuration tab 800 also may include a digitizer .eirorsrfield 804. 
This field may represent the number of reported digitizer API function call errors since the 



start of application. 

[00305] The camera configuration tab 800 may mclude a line rate control field 805. In 
one implementation, tiie line rate or digitizmg rate at which the BIS 20 captu res lines .pf data 
from tiie cameras may be contioUed such tiiat it is computed in one of two modes. A use 
encoder (automatic) mode, when enabled, computes and sets the digitizing line rate.based on 
the current measured speed of the belt^and the value of pixels per inch onthe belt by 



multiplying the belt speed (in/sec) by pikels'per inch on the belt 

[00306] The text field next to this mode may inform the user of tiie digitizing rate tiiat is 
computed and required. It should be noted tiiat when tiie belt changes, speed, tiiere is a time 
delay before tiiis is sensed by tiie system and tiie speed of tiie belt and tiius tiie digitizing rate 
updated. In one implementation, every time a new digitizing rate is computed, it is 
pared to tiie current setting and if it is differentby more tiian 200 Hz, tiien tiie new rate is 



IS 



com 



requested. Oflierwise, it is ignored. Ibis is because every time a new rate is:requested, tiie 
system must stop digitizing, set tiie new rate, and tiien restart digitizing. During tiiis time, a 
portion of tiie belt is not imaged by tiie system and tiius objects may not be detected. 
[00307] A use constant rate mode, when enabled, sets tiie digitizing line rate to flie 
constant rate set by the user in tiie constant rate field. In one implementation, two statiis 
fields allow tiie user to view tiie current digitizing rate settings. A digitizer rate field displays 
tiie rate at which tiie software system has requested tiie digitizer card to captiire data. The 
actual rate field displays tiie rate at which tiie application is actiially receiving data firom tiie 
digitizing card. This rate may be measured over a 30-60 second timeframe so fliere is some 
lag between tins and tiie digitizer rate when a new rate is set. 
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100308] In one embodiment, the user also may enable control of the line rate regardless of 
which mode the user has selected. This may be accomplished, for example, by checking the 



use 



software line rate control. When enabled, the digitizing card is directed to digitize at 



9000 Hz continuously. The digitizmg rate computed by the encoder mode is then used to 
sub-sample the captured data in order to build an image of non-overlapping and continuous 

belt 

[003091 In this mode, there will be a small amount of lag time between updating new 
digitizing rates based on the speed of the belt changing (which will make the objects being 
captured appear slightly distorted when llie belt is speeding up or slowing down) but no 
pieces of the belt will be missed because the digitizer is not being stopped, programmed, and 
restarted over and over. Instead, the software sub-sampling rate simply changes. For 
example, if the encoder mode calculates a digitizing rate of 4500 then the sub-sampling 
routine will extract every other line from the data captured by the digitizing card and build a 
frame up data from it before handing it to the rest of the application to process. 
[00310] The camera configuration tab 800 may include a gain field 806. This field may 
allow the user to select different camera gam values, hi one implementation, the camera gain 
values may range from Ix to 8x. It should be noted tiiat changing the gain will make the 
captured image data appear brighter at the cost of adding some noise to tiie data and at the 
cost of loosing some dynamic range of intensities. 

[00311] The camera configuration tab 800 may include an image alignment field 807. In 
one implementation, the BIS 20 may include two cameras, each of which captures 2048 
pixels of image data per line. This data is combined by the digitizer to make it seem like it is 
coming from one 4096 pixel resolution camera. In order for the image data to appear smooth, 
the data in liie overlapping areas from the two individual cameras must be aligned. 
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[00312] Alignment may be perfonned in one of two modes. In a.manual mode,^the BIS 
20 is informed to align the images by applying liie offeet vdues configured in the horizontal 
and vertical o£&et fields. In the automatic mode, the BIS 20 uses automated software in 

J 

order to align the images. The offiset values configured in the horizontal and vertical offset 
fields are used as an estimate of the true alignment values and the automated software 
searches an area, given by the search limit field, around these offsets to refine the alignment 
values to use on a>per detected object basis. 

[00313J The camera.configiu:ation.t^^ 800 may include a number of digitizer oye^rflpw 
errors field 808. This is a status field that represents the number of digitizer overflow errors 
that have been reported to the application by the digitizer since the start of the application. 
Each error causes the system to stop and restart acquisition in order to resyiichroni;2e with the 
cameras during which time image data of the moving belt will be missed and thus objects 
may not be detected. 

[00314] The camera configuration tab 800 may include a number of digitizer hardware 
exception error fields 809. This is a status field that represmts the nuinber of digitizer 
hardware exception errors, that have been reported to the application by the digitizer since the 
start of the application. Each error causes the system to stop and restart acquisition in order 
to resynchronize with the cameras during which time image data of the moving belt will be 
missed and thus objects may not be detected. 

[00315] The camera configuration tab 800 may include a reset digitizer after every 
detected object field 810. If enabled, the BIS 20 may reset the digitizer every time an object 
is detected during which time image data of the moving belt will be missed and thus objects 
may not be detected during this time. This mode may temporarily fix cameras having 
synchronization problems. 
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[00316] The camera configuration tab 800 may include a reset camera acquisition button 
811. If the camera data appears to be out of synchronization, the user may manually instruct 
the system to reset the digitizer by clicking tills button. 

[00317] Fig. 72 illustrates an encoder configuration tab 820 that may be implemented by 
the BIS 20. In general, the encoder configuration tab 820 may be used to control various 
encoder settings. 

[00318] As shown, the encoder configuration tab 820 may include a counts per meter 
field 82 1 . This field represents the number of encoder counts per meter of travel. In general, 
this field must be calibrated and set by the user for every installation of the BIS 20. 
[00319] The encoder configuration tab 820 may include a time between belt speed 
updates field 822. This variable represents how often the system computes a new belt speed. 
For example, if &is variable is set to the number 3, tiien every 3 seconds the system computes 

* 

a new belt speed. In general, Ihe amount of time between speed updates should be as smaU as 
possible while maintaining stabUity of the computed speed. If the time between speed 
updates becomes too small, the speed of tiie belt will show large variations and the time 
between updates should be increased. In practice, a reasonable amount of time between 
speed updates may be around 0.5 seconds. 

[00320] The encoder configuration tab 820 may include a time between belt motion log 
updates field 823. While the BIS 20 is running, it logs to disk the speed of the belt. This 
variable represents how often to log the speed of the belt to disk. 
[00321] The encoder configuration tab 820 may include a current count field 824. This 
variable represents a current encoder count iJiat the encoder counter card is keeping track of 
internally. The encoder configuration tab 820 may include a current position field 825. 
When file BIS 20 starts nraning, it starts to integrate tiie encoder counts received from the 
encoder counter card in order to generate a belt position. This variable represents the current 
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belt position since the system started running. The encoder configuration tab 820 also may 
■ - include a belt speed field 826 indicating the most recent computed speed of the belt and a 
filtered speed field 827 for displaying a filter speed. . ^. 

[00322] Fig. 73 illustrates amechanical splice configuration tab 830 which may be 
implemented by the BIS 20. In general, the mechanical splice configuration tab 830 allows a 
user to configure various mechanical splice detection settings, 

[00323] As shown, the mechanical.splice configuration tab 830 inay include a detection 
enabled field 83 1 . If this box is.checked, mechanical splice detection is enabled. If this box 
is not checked, mechanical splice detection is disabled. 

[00324] The mechanical splice configuration tab 30 may include a save detection statistics 
field 832. If this box is checked^ then the mechanical splice detection algorithm^ will save 
infomiation to disk while they run. In.general, this may slow down the detection algorithms, 
but may be usefiil in debugging the algoritimis offline by processing the logged data in the 
event that mechanical splices are not being detected. 

[00325] The mechanical splice configuration tab 830 may include a show detection 
statistics field 833. If this box is checked, a graph window may appear on the. screen. The 
graph may show the processing scores of the image data and the current mechanical splice 
threshold level. By inspecting the gr^ph as the system runs, an appropriate threshold 
multiplier level may be set that is significantiy above the background belt score and low 
enough to avoid missing the detection of any splices. 

[00326] The mechanical splice configuration tab 830 may include a splice detection 
algorithm field 834. In one implementation, a user may select one of three different , 
mechanical splice detection algorithms. 

[00327] The mechanical splice configuration tab 830 may include a horizontal edge 
algorithm field 835. This area contains all variables that pertain to how the horizontal edge 
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mechanical splice detection algorithm works. The in row pixel increment value represents 
how many pixels within each row should be processed to come up with a score for this image 
row. For example, a 1 would mean processing every pixel while a 4 would mean processing 
every fourth pixel. In general, the higher the number, the less processing involved in 
detection. 

[00328] The row gap value represents the gap between the current row being processed 
and the row to use when computing a gradient/edge score for this row. For example, a 1 
would mean use the previous row while a 4 would mean use the row four rows before the 

■ 

current one when computing gradient scores. In general, a value of 3 typically is used. 
[00329] The number of rows in splice value represents the number of rows a healthy 
mechanical splice takes up in an image firom the top of the top row of clips to the bottom of 
the bottom row of cUps. In general, if this value is improperly set, then the splice image will 
not be centered in the image. The threshold multiplier value is the multiplier applied to the 
running average of edge scores that determines the threshold level that must be passed in 
order for processed areas of the belt to be classified as part of a mechanical splice. 
(003301 The mechanical splice configuration tab 830 may include a horizontal comb 
algorithm field 836. In ^neral, this area contains all variables that pertain to how the 
horizontal comb mechanical splice detection algorithm works. 
[00331] The hole spacing value represents the numbCT of pixels between the center of 
adjacent zipper holes in the same row of clips. The slide iterations value represents the 
number of different comb offset locations to evaluate when attempting to fit the comb to a 
particular zone of image data. In general, the lower the number, the fester the algorithm will 
. However, this is at the cost of the comb not matching up exactly with the image data. In 



run 



practice, a value of 8 has been found to be acceptable. 
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[00332] the nianber of rows in splice value represents the nmriber of rows a healthy 
niechanical splice takes up iii ah image &bm the top of the top^rowof dips to theibottom of 
the bottom row of clips. In general, if this value is improperly set, then the splice will not be 
centered m the image. The threshold multiplier value is the multiplier applied to the running 
average of comb scores tha:t detennines the threshold level that must be passed in order for 

« 

processed areas of the belt to be classified as part of the mechanical splice. 
[003331 The mechanical' splice configuration tab 830 may include a vertical keys 
algorithm field 837. In general, thiis area contains all variables that pertain to how the vertical 
keys algorithm works. 

[00334] The whole height value r€^>resents the height (in pixels) a zipper hole spears in 
ti&e mechanical splice image. The pattern height value represents the number, of rows 
between the bottom rivets of a cUp in the top and the top rivets of a clip in the bottom row in 
a mechanical splice image. 

[00335] The m row pixel increment value represents how many pixels within each row 
should be processed to come iip with a score for this hnage row. For example, one (1) would 
mean process every pixel while four (4) would mean process every fourth pixel. In general, 
the higher the number, the less processing involved in detection. 

t 

[00336] The number of rows in splice value represents the number of rows a health 
mechanical spUce takes up in an image firom the top of the top row of clips to the bottom of 
the bottom row of clips. In general, if this value is improperly set, then the splice image will 
not be centered in the image. The threshold multiplier value is a multiplier applied to the 
running average of edge scores that detemimes the threshold level that must be passed in 
order for processed areas of the belt to be classified as part of a mechanical splice. 
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[00337] The mechanical splice configuration tab 830 may mclude a general algorithm 
statistics field 838. In one implementation, there are four processing statistics common to 
each detection algorithm. 

[00338] One processing statistic may be initialization count WTien the detection 
algorithm first starts processing the image data or if the control variables of a detection 
algorithm are changed, a certain amount of image data must be processed before a good 
estimate for the mechanical splice threshold level can be computed. This variable represents 
the number of rows still required before detection will take place. A value of zero (0) means 
that initialization is complete and splice detection can take place. 
[003391 Another processing statistic is processing index. This variable represents the 
image slot number within the live belt image ring buffer that is currently being processed by 
the detection algorithm. Another processing statistic is images queued. This variable 
represents the number of unage ftames within the live belt image ring buffer that are waiting 
to be processed by the detection algorithm. If this variable is constantly growing, then the 
detection algorithm is running too slow and cannot keep up with the data being captured. 
[00340] Another processing statistic is buffer overflows. If the detection algorithm 
cannot process data as fast as it is being captured, then eventually an overflow will occur. 
This variable represents the number of times a detection processing overflow has occurred. 
[00341] Fig. 74 illustrates a data logger configuration tab 840 that may be implemented 
by the BIS 20. In general, the data logger configuration tab 840 allows a user to control 
various data logger settings. 

[00342] As shown, the data logger configuration tab 840 may include a raw belt images 
field 841. In general, this area specifies how, when and where live belt image data will be 
logged by BIS 20. If the log raw belt images box is checked, then live belt image data 
logging will be enabled. 
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[00343] The disk location field can be set by pressing the browse button in order to 
'navigate through an^ sdect a folder via a'folder viewer application. The available disk space 
variable represents the nwnber of megabytes of free disk space on the.disk where Ihe.live belt 
iniage data is stored. The reduction factor area allows the user to select fee resolution of the 
logged live belt image date: The logging index variable represents the image slot number 
within the Uve belt image ring buffer that is currently being logged. The images queued 
variable represents the number of image ftames within the Uvebelt iinage ringbuffer that are 
waiting to be logged. The buffer overflows variable represents the iiumber.of. times a live 
belt image logging overflow 'has occurred. 

[003441 The data logger c(Kifiguration tab 840 may include a detected object images field 
842. If the log detected object linages box is checked, then every detected object that the BIS 
20 detects will be logged to disk. The disk location field may be set by pressing the browse 
button in order to navigate through and select a folder via a folder viewer application. Ibe 
available disk space variable represents tiie nmnber of megabytes of firee disk space on the 
disk where the detected object image data is stored. 

[003451 Fig. 75 illustrates a data player configuration tab 850 fliat may be implemented 
by the BIS 20. In general, the data player configuration tab 850 allows a user to contirol 
various data player settings. 

[003461 As shown, the data player configuration tab 850 may include a data player 
enabled field 851 . In general, to enable tiie data player mode, this box must be checked. 
[003471 The data player configuration tab 850 may include a raw belt images field 852. 
Tins area specifies where tiie live belt images are located on disk tiiat should be used and the 
range of image numbers to use during playback. The disk location field may be set by 
pressmg the browse button in order to navigate through and select a folder via a folder viewer 

application. 
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[00348] The start index indicates the iinage number from which playback should start. 
The end mdex indicates the image number at which playback should stop. The loop forever 
box, if checked, enables looping over the same range of images. The reading index indicates 
tiie current image number being read from disk and loaded into the live belt image ring 
buffer. The into live belt buffer indicates the image ring buffer slot number that the current 
image is being loaded into from disk. 

[00349] The data player configuration tab 850 also may include a belt speed field 853 for 
indicating the speed of the belt. 

[00350] Fig. 76 illustrates an identification configuration tab 860 that may be 
implemented by the BIS 20. In general, the identification configuration tab 860 may aUow a 
user to control various identification configuration settings. 

[00351] As shown, the identification configuration tab 860 may include an identification 
enabled field 861. If checked, then identification is enabled. Otherwise identification is 

disabled. 

[00352] The identification configuration tab 860 may include a point of origin field 862. 
This field may represent the type of object that the BIS 20 should use as a reference for the 
point of origin on the belt. Selecting first mechanical splice makes the first detected 
mechanical splice the point of origm. Selecting first vulcanized splice makes the first 
vulcanized spUce (detected by detecting a fiducial patch pair) the point of origin. Selecting 
fiducial marker makes the special fiducial marker patch pair (that defines the point of origin) 
the point of origin on the belt 

[00353] The identification configuration tab 860 may include a splice on belt field 863 . 
This field may be set if either the point of origin is selected to be the first mechanical splice 
or the first vulcanized splice. The first mechanical splice may be set to be the number of 
mechanical splices on the belt. The first vulcanized splice may be set to be the number of 
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vulcanized splices on the :belt that have fiducial markers installed on theni,such that they may 
be:detected'bytiie:BIS20. 

[00354] The identification configuration tab 860 may include a reset pattern based on idle 
belt.field 864. This areamay be used to configure how the identificatipn process should 
interpret the belt being idle (stopped). Resetting enabled, if checked, f enables the resetting of 
object identification tags if the belt is idle for more than the configured period of time. The 
reset after belt idle value indicates the number of minutes that a belt may be idle before 
resetting the identification state. 

[00355] The identification configuration tab 860 may include an identification, state 
information field 865. This area may be used to display the current intemd state of the 
identification system. The point of origin detected field indicates whether or not the point of 
origin has been detected. The state of belt pattern field indicates whether the belt pattern is 
known. The number of objects in pattem field provides the number of objects on the belt 
The time belt idle field indicates the number of seconds that the belt has been idle. 

» * 

[00356] The next mechanical spUce ID indicates the ID that will be assigned to the next 
detected mechanical splice. The next vulcanized splice indicates the HD.that will be assigned 
to the next detected vulcanized splice. The number of mechanical splices on last belt 
revolution indicates the number of mechanical splices that were detected on the last belt 
revolution. The number of mechanical splices on current belt revolution indicates the number 
of mechanical splices that have been detected so far on the current belt revolution. The 
number of vulcanized splices on last belt revolution indicates the number of vulcanized 
splices that were detected on the last belt revolution. The number of vulcanized splices on 
current belt revolution indicates the nmnber of vulcanized splices that have been detected so 
far on the current belt revolution. 
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[00357] Fig. 77 illustrates a mechanical splice scoring configuration tab 870 and that may 
be implemented by the BIS 20. In general, the mechanical splice scoring configuration tab 
870 allows a user to control various mechanical splice scoring configuration settings. 
[00358] As shown, the mechanical splice scoring configuration tab 870 may include an 
analyzer enabled field 871. If enabled, detected mechanical splices will be analyzed for 
defects and scored by a primary zipper hole method. 

[00359] The mechanical splice scoring configuration tab 870 may include a save scoring 
statistics field 872. If enabled, the scoring algorithm will log data to disk while it analyzes 
the mechanical spUce image. This data may be examined off-line to determine the source of 
scoring failure. 

[00360] The mechanical splice scoring configuration tab 870 may include a scoring mput 
configurations field 873. In general, this area allows a user to configure various setting that 
control how the analyzing algorithm works. 

[00361] The number of zones field indicates how many zones into which the image 
should be split The erode iterations field indicates how many times the image should be 
eroded in order to enhance the zipper holes. The edge thickness field indicates the thickness 
of the edges in the vertical edge magnitude image. The teeth width field indicates the width 
(in pixels) of a clipped tooth The hole search width and height field indicates how fer to 
search from the estimated zipper hole center for a better hole center. The second zipper 
search distance field indicates how many rows may separate the top and bottom row of clips 
taking into account damaged clips. The gap between clips field indicate the number of pixels 
between two clips. 

[00362] The clip width field indicates the number of pixels wide a clip is in the image. 
The clip height field indicates tiie number of pixels ftom the top of the zipper hole to the top 
of the clip in the image. The hole width field indicates the number of pixels wide a zipper 
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hole is^in the image. The -hole height fi^^ indicates the number of pixels^high a zipperihole is 
in the image::The:zipper thresholdmultiplier indicates the multiplie to 
multiply the ?zipper response ifilter mean response by in order to^compute a threshold level for 
zipper detection. [The hole tolerance field indicates the number of pixels that the zipper hole 
candeviate ftom the median zipper hole height beforeit is deemedidefective. The distortion 
search distance field indicates the number of different off-set zipper detection filters to use to 
detect the zipper location. 

[00363] The mechanical splice scoring configuration tab 87Q may include a^scoring 
output display settings field 874. In general, this area may control what parts of the analyzing 
results get displayed on top of the mechanical splice image when^displayed in the object 
window. ^ ■ 

[00364] The show detected belt edges field, if enabled, shows the detected belt edges on 
the image. The show zone boundaries field, if enabled, shows the different zone boimdary 
Hnes on the image. The show zipper detection results field, if enabled, shows the center 
location of the estimated and defined zipper holes and the location of the detected pin in each 
section. The show clip detection results field, if enabled, shows bounding boxes around the 
detected clips in the top and bottom row on the image. The show teeth hole growing results 
field, if enabled, shows bounding boxes around each zipper hole on the image. The highlight 
bad teeth holes field, if enabled, shows a box with an "x" in it on each zipper hole that was 
determined to be defective on the image. The show clip mate results field, if enabled, shows 
clip mate pairs by drawing a line coimecting the bottom and top clips on the image. 
[00365] The mechanical splice scoring configuration tab 870 may include a functional 
clip pair scoring configuration slider field 875. The two slider positions may be changed in 
order to set the different levels of scoring. Scores in red may be used to show splices that 
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have serious defects. Scores in yellow may be used to show splices that have marginal 
defects. Scores in green may represent splices that have minor, if any, defects. 
[003661 The mechanical splice scoring conl&guration tab 870 may include a scoring speed 
loader field 876. The user may run previously detected mechanical splices through the splice 
analyzer by using the scoring speed loader. Clicking on the scoring speed loader button 
brings up a disk folder viewer window. The user may navigate to the folder containing the 
previously detected mechanical splices. The BIS 20 will load and score each mechanical 
splice using the scoring configuration settings one at a time. The scoring of the splices will 
continue until all previously detected splices have been analyzed or until there is a break in 
the image sequence numbers. 

[003671 The mechanical splice scoring configuration tab 870 may include an images 
queued field 877. This field may specify the number of images currently in the analyzer 
queue that are waiting to be analyzed. It should be noted that if this number is constantly 
increasmg, then an overflow may be imminent The mechanical splice scoring configuration 
tab 870 also may include a data overflow field 878. This field may represent the number of 
analyzer image overflows that have occurred. 

[00368] Fig. 78 illustrates a general configuration tab 880 that may be implemented by 
the BIS 20. In general, the general configuration tab 880 may allow a user to control various 
general configuration settings. 

[00369] As shown, the general configuration tab 880 may include an image settings field 
881. This area may control how the unages in the object image area of the main graphical 
user interfece screen appear. The flip image verticaUy field, if enabled, flips the image 
vertically, before displaying it in tiie object image area window. The enhance image field, if 
enabled, histogram equalizes the image before it is displayed in the object image area 
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window. The brighlness slider bar controls by how much intensity each pixel in theMage is 
increased/decreased before it is displayed in the object image area window.. 
[003701 The general configuration tab 880 may include a histoiy imag^^ This 



area 



may control the Woping update mode of the object hnage^area. The loop delay field 



indicates how often to update the object image area window when iniooping mode. The loop 
links field specifies how far back from the current number of detected objects to.display 
before going back to'the latest detected object when in looping mode. The showing index 
field represents the bbjed detection-riumber of liie current object being displayed-in the object 

image area window. 

(003711 The general corifigiiration tab 880 may include a network 10 field 883. This area 
may control all communicatioh setting between the BIS 20 and a surface server machine. 
The enable network 10 field enables networkmg to be transmitted firom the. BIS 20 to iJie 
surface server machine grid. Tthe enhanced JPEG images enables detected qbject.iinage data 
to be histogram equalized before sending the image data to the surfece server machine. The 
JPEG quality (1-100) field specifies the quaUty level to use when compressing the images 
into JPEG format. The latest JPEG size field represents the size of the last object image that 
was transmitted to the surfiuje server machine. 

[003721 The general configuration tab 880 may include a console messages field 884. 
Ibis area may control what type of messages are displayed on the console window. The 
display debugged messages field enables debugging information to be displayed on the 
consol window. The display error messages field enables error messages to be displayed on 
the console. 

[003731 The general configuration tab 880 may include a TOG speed loader field 885. A 
ly load in previously detected objects form disk in order to view them within BIS 20 



user ma^ 



by clicking the TOG speed loader button. This will bring up a folder navigation vdndow. 
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The user then navigates through the disk folder and selects the folder that contains the 
previously detected objects. 

[003741 The general configuration tab 880 may include a display live belt images field 
886. If enabled, a window is brought up that displays images of latest data. A window may 
be updated by a rate of five times per second. As such, the user is not seeing the entire belt 
but rather snap shots of it. The general configuration tab 880 also may include a conserve 
disk space field 887. If enabled, BIS 20 is directed to conserve disk space. This may mean 
that when the BIS 20 starts up, it will purge outdated data. In addition, BIS 20 may conserve 
disk space while running by writing over images in the TOC list. 

[00375] Fig. 79 illustrates a fiducial detection configuration tab 890 that may be 
implemented by the BIS 20. In general, the fiducial detection configuration tab 890 may 
allow a user to control various fiducial detection configuration settings. 

[00376] As shown, the fiducial detection configuration tab 890 may include a detection 
enabled field 891 . If this box is checked, mechanical splices and/or fiducial patch detection 
by the fiducial object detection and classification algorithm will be enabled. 

[00377] The fiducial detection configuration tab 890 may include a save detection 
statistics field 892. If this box is checked, then the detection and classification algorithm will 

save information to disk while running. This may slow down the algorithm, but maybe 

» 

useful in debugging the algorithm offline by processing the logged data if mechanical q)lices 
and/or fiducial patches are not being detected and/or classified. 

[003781 The fiducial detection configuration tab 890 may include a show detection field 
893. If this box is checked, a graph window may appear on the screen. The graph window 
may show flie processing scores of the image data and the current detection threshold level. 
By inspecting the graph as the system runs, an appropriate threshold multiplier level may be 
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set that is significantlyiabove the background belt score and low enough to avoid rmissing the 
detection ofany.^splices and/or fiducial patches. _ , 

[00379.] : The fiducial detection configuration tab 890 may include , a show classification 
field 894. ffthis boxed is checked, then- a graph window may appear pn^ the scre^^^ The 
graph window may show the classificatiori scores of the image data ^d thQ currpnt.fiducial 
patch threshold level. By inspecting the graph as the system runs, and appropriate threshold 
multiplier level may ^be set that is significantiy above the, backgroiui<i spore enough 
to avoid classifying any.fiducial patches as mecha^ 

[00380] The fiducial detection configuration tab 890 may. include a type of 9bjects to 
detect field 895. The fiducial detection algorithm may be used to detect fiducial patches 
and/or mechanical splices. This area allows the user to select the type .of objects to be 
detected by the fiducial algorithm. In one implementation, the user .may s^^^^^ only 

* 

fiducial patches, only mechanical splices, or both fiducial.patehes ancj mephanical splices. 

[00381] The fiducial detection configuration tab 890 may include a fiducial characteristics 
field 896. This area may allow the user to set the geometric characteristics of the fiducial 
patches that the system will be detecting. The fiducial widtii field indicates the vvidth of the 
fiducial patch specified in mches. The fiducial height field indicates the height of the fiducial 
patch specified in inches. The checker width field indicates the width of one of the checker 
board fiducial squares specified m mches. The checker height field indicates the height of 
one of the checker board fiducial squares specified in inches. The circle radius field indicates 
a radius of the circle located in the center of the fiducial patch specified in inches. 

[00382] The fiducial detection configuration tab 890 may include an object detection 
parameters field 897. This area may allow the user to configure or tune tiie fi^ducial 
algoritimi. 



83 



wo 03/059789 PCT/US03/00966 

[003831 The column increment value represents how many pixels wiAin each row should 
be processed to come up with a score for this image row. For example, a 1 would mean 
process every pixel while a 4 would mean process every fourfh pixel. In general, the higher 
the number, the less processing involved in detection. However, this may lower the signal- 
to-noise scores between backgroimd belt and objects. 

[00384] The row increment value represents how often to sample and process rows in the 
captured data. For example, a 1 would mean process every row while a 4 would mean 
process every fourtii row. In general, the higher the number, the less processing involved in 
detection. However, this may lower the signal-to-noise scores between background belt and 
objects. 

[003851 The detection threshold multiplier is the multiplier applied to the running average 
of scores that determines &e threshold level that must be passed m order for processed areas 
of the belt to classified as part of either a mechanical splice or a fiducial patch. The point of 

I 

4 

origin masks separation value represents the maximum distance by which two patches can be 
separated in order for the BIS 20 to classify them as the fiduciary-of-origm. If two 
coiisecutive patches are separated by more than this distance, then they will be classified as a 
vulcanized splice. 

[003861 The max distance between patches value represents the maximum distance by 
which two patches that make up part of a vulcanized splice are expected to be separated in 
order to be detected by the BIS 20. In general, this value should be set slightly higher than 
the length of the longest vulcanized splice on the belt. If two consecutive patches are 
detected to be separated by more than &is distance, then the BIS 20 will classify the detection 
as a false positive and ignore this possible splice. 

[003871 The fiducial detection configuration tab 890 may include a point of origin style 



field 898. This area may allow a user to configure how the fiducial point-of-origin is 
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instaiied on the belt that BIS 20 is mspecfing. The standalone field indicates that the -fiducial 
pktches that mike up the point-o'f-ori^ are instaUed on the belt-away from all other patches. 
Tht part of vulcanized Sjplice field indicates that the fiducial-patches that make up the point- 
of^rigiii we mstaUed o^^ 

piches is part of the point-of-origin and is also one of the patch-pair that is used to mark the 



beginnmg and end of a vulcanized splice. 

[6038^f The 'fiducial detection configuration tab 890 may include an object classifier 
parameters field 899. This area may allow the user to configure parameters that are.relevant 
to the ciassificatibh of detected' objects. Ihe fiducial threshold multipUer is the multiplier 
applied to the runnmg average of scores that determines the threshold level that must be 
passed in order for detected objects to be classified as a fiducial patch. 
[00389] the fiducial detection configuration tab 890 also may include a processing field 
900: hi genial, this area may be used to provide feedback to the user as to Ihe as to the state 
of the fiducial algorithm. When that detection algorithm first starts processing the image data 
or if the object detection parameters of the defection algorithm are changed, a certain amount 
of unage (kta miist be processed before a good estimate for the object detection threshold 
level is obtained. The initiahzation count variable represents the number of rows still 
required before detection will take place. A value of zero (0) means that initiahzation is 
complete and object detection can take place. 

[003901 The processing index variable represents tiie image slot number within tiie live 
belt image ring buffer that is currentiy being processed by the detection algorithm. The 
queued variable represents the number of image frames witiiin the live belt image ring buffer 
that axe waiting to be processed by tiie detection algorithm. If fliis variable is constantiy 
increasing, the detection algoritimi may be running too Slow and cannot keep up witii tiie data 
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being captured. The overflows variable represents the number of times a detection overflow 
has occurred. If the detection algorithm cannot process data as fast as it is being captured. 
[00391] Fig. 80 illustrates another embodiment of a conveyor belt system 100. In one 
general aspect, the conveyor belt system 100 is directed to systems and techniques for 
detecting defective conditions in a conveyor belt 101 that may contribute to belt failure and 
for alertmg management and/or maintenance personnel (e.g., via audio or visual alarm) of 
such conditions prior to belt failure. For sunplicity, the basic components are depicted. 
However, as would be understood by one of ordmary skill in the art, the system described 
below may include various other components and structures in actual implementation 
consistent with aspects of the present invention. 

[00392] As shown, the conveyor belt system 100 includes a controller 102 in 
communication with an encoder 103, a focused light source 104 and a camera 105. In 
general, the controller 102 may be unplemented as one or more computers and/or computer 
systems for performing the functions described herein. Examples include, but are not limited 
to, a geneml-purpose computer, a special-purpose computer, a personal computer (PC), a 
workstation, a network server, a terminal, a virtual machine, a laptop computer, a 
microprocessor, an integrated circuit, or any other device, machine, tool, equipment, 
component, or some combination thereof capable of responding to and executing instmctions. 
[00393] The encoder 1 03 may perform functions, such as, computing the current belt 
speed and position, computing desired digitized line rate based on the current belt speed, and 
recording the belt speed - including monitoring the amount of time the belt is idle. In one 
implementation, the controller 102 interacts with the encoder 103 to control the speed of 
image capture. 

[00394] The focused light source 104 is configured to direct focused light 106 at the 
conveyor belt 101 . In one embodiment, the focused light source 102 may include a laser that 
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generates a laser beam. As depicted, the focused light' rOS source may be aimed at an angle a 
with reject to a baseline. In most cases, reflected light 1 07 will occur as fiie Tocused light 
106 bdntacWfflid is reflected by the conveyor belt 101 . ' That is, apart firom having defects 
such as hbles fflod tears, the belt 1^ 

[003^51 The" camera 105 may be corifigiired'tb detect and receive the reflected light 107. 
In one implementation, the camera 105 is a line scan camera that inay provide a digitized 
inrnge coniainiiig on^ row of pixels. The field of view for die camera 102 may be defined 
between die fir^t pixel 108 and the last pixel 109 in the row of pixels. As shown in the figure, 
the focused light 105 is reflected by the belt 1 0 1 within the field of view of the camera 1 05 at 
an intermediate pixel location 1 10. 

[003961 In cine implementation, the camera 105 reports the detection of the reflected Ught 
i07 to the controller 102. Based on the pixel location 110, the cohtiroller 102 can compute 
the distance J to the pixel. In general, the distance d may be representative of the range 
separating the conveyor belt 101 and the camera 105. In one embodiment, the controller 102 
calculates a range profile for a row of pixels spaniiing the width of the belt In general, die 
range profile of the belt surfece will be calculated at relatively short intervals so that data for 
most of the conveyor belt 101 is collected. For example, data may be collected for every 2 
inches along the length of the belt 101. 

[00397] In general, the range data will be collected for portions of flie conveyor belt 101 
that are capable of reflecting die focused Ught 106. Because die conveyor belt 101 may not 
be completely flat, it is expected for the range values to vary. In some cases, however, the 
conveyor belt 101 may include defects such as holes and tears fliat prevent die reflection of 
die focused light 105. For diese portions, range data is unavailable and die distance d will be 
reported as zero. It also should be noted diat for defects such as raised edges, die distance d 
will be reported to be lower tiian for the rest of the belt 
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[00398] In onp implementation, the controller 102 may process the collected range data to 
create a range point cloud or "dust cloud" image. In general, the range point cloud provides a 
three-dimensional topography of the belt 101 which may be visually displayed to a user. Fig. 
81 illustrates one embodiment of a belt topography that may be generated according to the 
present invention. By viewing the topography, is possible to check the belt 101 for 
mechanical splice defects (e.g., missing clips, broken clips, broken pins, missing rivets, 
and/or worn or trailing edges), vulcanized splice defects (e.g., tearing of upper belt ply and/or 
delaminating of belt plies), and/or belt material defects (e.g., holes, tears, "flappers", gouges, 
and/or excessive scoring). 

[00399] In some embodiments, the functionalily and/or components of the conveyor belt 
system 100 may be implemented by a BIS 20. For example, the BIS 20 may display a three- 
dimension topography of the belt surface to a user in addition to performing mechanical 
splice detection, vulcanized splice detection, and/or object detection, as described above. 

[00400] A number of implementations have been described. Nevertheless, it will be 
understood that various modifications may be made and that other implementations are 
within the scope of the following claims. In particular, fiduciary markings are not required to 
be associated with a vulcanized splice. Namely, one or more fiduciary markings may be 
placed anywhere one the surface of the belt and monitored (e.g., for stretching) to provide an 
indication of belt quality. Furthermore, while one example of a fiduciary marking is a 
checkerboard pattern, any type of recognizable mark, pattern, line, or shape may be used. 

[00401] Other embodiments are within the scope of the followmg claims. 
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CLAIMS 

What is claimed' fe: ' 

1 . An inspection system for detecting £md reporting^conditions of a conveyor 

belt, the systan comprising: 

a conMler for receiving image data from at least bne camera stractured and arranged 
to capture an image of a portion of a conveyor belt, for detecting an object in the portion of 
the conveyor belt based on the received hnage data, and for generating status information 
associated with liie portion of the conveyor belt based on flie detected object 



2. The system of claim 1 , wherein the controller classifies the detected object. 



3. The system of claun 2, wherem the controller analyzes the detected object 
based on obj ect classification. 



4. The system of claim 1, wherein Ihe detected object comprises a mechanical 



spUce. 



■ 

5 . The system of claim 4, wherem the controller detects the mechanical splice by 
edge filtering the image data. 



6. The system of claim 4, wherein the controller detects the mechanical splice by 
searching for a zipper pattern in image data. 



7. The system of claim 4, wherein the controller detects the mechanical spUce by 

t 

searching for a hole pattem in the image data. 
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8. The system of claim 4, wherein status infonnatioii comprises a score assigned 
to the detected mechanical splice by the controller. 

9. The system of claim 8, wherein the score is based on a zipper hole pattem. 

10. The system of claim 8, wherein the score is based on a number of functional 
clips included in detected mechanical splice. 

1 1 . The system of claim 1 , wherein the detected object comprises a vulcanized 

splice. 

12. The system of claun 1 1 , wherem the controller detects the vulcanized splice 
by locating at least one fiduciary marking corresponding to the location of the vulcanized 
splice. 

1 3 . The system of claim 1 2, wherein the controller locates the at least one 
fiduciary marking by edge filtering. 

14. The system of claim 12, wherein the fiduciary marking is vulcanized to the 
conveyor belt 

15. The system of claim 12, wherein the fiduciary marking comprises at least one 
of a mark, patch, pattern, shape, Une or grid. 
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1 6. The system of claim 12, wherein the controller locates a center of one or more 



fiduciary markings. 



1 < 



17. The system of claim 12, wherein the controller locates a rotation angle of the 
at least one fiduciary marking. 



18. The system of claim 12, wherem the controller locates a pair of fiduciary 
markings bounding the vulcanized splice. 



19. The system of claim 1, wherein the detected object comprises a material defect 



in the belt. 



a 



20. The system of claim 19, wherem the material defect comprises at least one of 
hole, rip, worn edge, splice, score, or gouge in the conveyor belt. 



21. The system of claim 1, wherein the detected object comprises abelt marking. 



22. The system of claim 21 , wherein the controller locates a center of one or 



more 



belt markings. 



23. The system of claim 21, wherein the controller analyzes Ihe belt marking for 
distortion indicative of a defective condition of the conveyor belt. 



24. The system of claim 23. wherein distortion comprises stretching of the belt 



marking. 
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25. The system of claim 23, wherein distortion comprises stretching between a 
pair of belt markings. 

26. The system of claim 21 , wherein the belt marking is vulcanized to the 
conveyor belt. 

27. The system of claim 2 1 , wherein the belt marking comprises at least one of a 
mark, patch, pattem, shape, line, or grid. 

28. The system of claim 1, wherein the detected object comprises reflected light 

29. The system of claim 28, wherein the reflected light is generated by a focused 
light source structured and arranged to direct focused light at the conveyor belt 

* 

30. The system of claim 29, wherein the focused light source comprises a laser. 

3 1 . The system of claim 28, wherein the controller generates a range profile based 
on properties of the reflected light. 

32. The system of claim 3 1, wherein the status information comprises a three- 
dimensional topography of the conveyor belt based on the range profile. 

33. The system of claim 32, wherein the three-dimensional topography comprises 
at least one of a hole, rip, wom edge, splice, score, or gouge in the conveyor belt. 
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34. The system of claim 1, wherein the status information comprises a digital 
image of the detected object. 

I 
I 

35. The system of claim 1, wherein .the status information comprises a plurality of 
digital images of the detected object captured over a peripd of time. 

36. The system of clarai 35, wherem the plurality of images shows degradation of 
the detected object over time. 

*37. The system of claim 1 , wherein the controller is configured to assign an 
identification tag to a detected object. 

38 . The system of claim 37, wherein the identification tag is assigned based on at 
least one of a reference object, a point-of-origin, recognized pattern, correlation between 
images, a health score, and object degradation. 

39. The system of claim 1, wherein the status information comprises an alarm 

* 

condition. 

40. The system of claim 1, further comprising a user interface, in communication 
with the controller, configured to display a visual representation of the status information. 

41 . The system of claim 1, further comprising a remote element, in 
communication with the controller, for enabling remote access to the status information. 
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42. The system of claim 1 , further comprising an encoder for monitoring speed of 
the conveyor belt. . 

43. An inspection method for detecting and Tq)orting conditions of a conveyor 
belt, the method comprising: 

receiving image data from at least one camera structured and arranged to capture an 

image of a portion of a conveyor belt; 

detecting an object in the portion of the conveyor belt based on the received image 

data; and 

generating status information associated with the portion of the conveyor belt based on the 
detected object. 

44. The method of claim 43, further comprising displaying a visual representation 

of the status information. 

45 . The method of claim 43, further comprising classifying the detected object. 

46. The method of claim 43, wherein the detected object comprises a mechanical 

splice. 

i 

! 

47 . The method of claim 43 , wherein the detected object comprises a vulcanized 

splice. 

48. The method of claim 43, wherein the detected object comprises a material 
defect in the conveyor belt 
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marking. ' ■ - 

- 50;' The method of claim 43 ^ wherein the ^deJtected object comprises reflected light. 

5 L A program stored on a computer readable medium and executable by a 
computer, the program comprising instructions for;^ 

receiving image data from at least one camera stmctured and arranged to capture an 
image of a portion of a conveyor belt; - - ' * 

detecting an object in the portion of the conveyor belt based on the received image 
data; and 

generating status information associatied with the portion of the conveyor belt based on the 
detected object 

52: The program of claim 51, further comprising instructions for displaying a 
visual representation of the status information. 

53 . The program of claim 5 1 , further comprising instructions for classifying the 
detected object. 

54. The program of claim 5 1 , wherein the detected object comprises a mechanical 

splice. 

55. The program of claim 51, wherein the detected object comprises a vulcanized 

splice. 
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56. The program of claim 5 1 , wherein the detected object comprises a material 
defect in the conveyor belt. 

57. The program of claim 5 1 , wherein the detected object comprises a belt 
marking. 

5 8 . The method of claim 5 1 , wherein the detected object comprises reflected light 

59. An inspection system for detecting and reporting conditions of a conveyor 

belt, the system comprising: 

means for receiving image data from at least one camera structured and arranged to 

capture an image of a portion of a conveyor belt; 

means for detecting an object in the portion of the conveyor belt based on the received 

image data; and 

means for generating status information associated with the portion of tiie conveyor belt 
based on the detected object. 

60. The system of claim 59, forther comprising means for displaying a visual 
representation of the status information. j 

61 . The system of claim 59, further comprising means for classifying the detected 

object. 
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62. The system of claim 59, wherein the detected object comprises a mechanical 



splice. 



63. The method of claim 59, wherein the detected object comprises a vulcanized 



splice. 



64. The method of claim 59, wherein the detected object comprises a material 



defect in the conveyor belt. 



65 . The method of claim 59;1 wherein the detected object comprises a belt 



marking. 



66. The method of claim 59, wherein the detected object comprises reflected light. 
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